Sep 28 14:53:09 devstack cinder-volume[74860]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:53:09 devstack cinder-volume[74860]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:53:09 devstack cinder-volume[74860]: we strongly recommend against using it for new projects. Sep 28 14:53:09 devstack cinder-volume[74860]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:53:09 devstack cinder-volume[74860]: framework. For more detail see Sep 28 14:53:09 devstack cinder-volume[74860]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:53:09 devstack cinder-volume[74860]: import eventlet # noqa Sep 28 14:53:12 devstack cinder-volume[74860]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74860) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:53:12 devstack cinder-volume[74860]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74860) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:53:12 devstack cinder-volume[74860]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74860) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:53:13 devstack cinder-volume[74860]: INFO dbcounter [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Registered counter for database cinder Sep 28 14:53:13 devstack cinder-volume[74860]: DEBUG oslo_db.sqlalchemy.engines [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74860) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:13 devstack cinder-volume[74860]: DEBUG dbcounter [-] [74860] Writer thread running {{(pid=74860) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:53:13 devstack cinder-volume[74860]: INFO cinder.rpc [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:53:13 devstack cinder-volume[74860]: INFO cinder.rpc [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:53:13 devstack cinder-volume[74860]: DEBUG oslo_db.sqlalchemy.engines [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74860) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:13 devstack cinder-volume[74860]: INFO cinder.volume.manager [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Determined volume DB was empty at startup. Sep 28 14:53:13 devstack cinder-volume[74860]: DEBUG cinder.volume.manager [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74860) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:53:13 devstack cinder-volume[74860]: INFO cinder.volume.manager [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:53:13 devstack cinder-volume[74860]: WARNING stevedore.named [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:53:13 devstack cinder-volume[74860]: WARNING castellan.key_manager [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:53:13 devstack cinder-volume[74860]: WARNING cinder.keymgr.conf_key_mgr [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:53:13 devstack cinder-volume[74860]: DEBUG cinder.volume.drivers.lvm [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74860) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 14:53:13 devstack cinder-volume[74860]: DEBUG oslo_concurrency.processutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74860) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_concurrency.processutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] CMD "cinder-rtstool verify" returned: 0 in 0.494s {{(pid=74860) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_db.sqlalchemy.engines [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74860) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:14 devstack cinder-volume[74860]: INFO cinder.rpc [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 14:53:14 devstack cinder-volume[74860]: INFO cinder.rpc [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 14:53:14 devstack cinder-volume[74860]: WARNING stevedore.named [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:53:14 devstack cinder-volume[74860]: WARNING castellan.key_manager [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:53:14 devstack cinder-volume[74860]: INFO cinder.volume.manager [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_db.sqlalchemy.engines [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74860) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:14 devstack cinder-volume[74860]: INFO oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Starting 1 workers Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Started child 75004 {{(pid=74860) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Full set of CONF: {{(pid=74860) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] ******************************************************************************** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Configuration options gathered from: {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:53:14 devstack cinder-volume[75004]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] ================================================================================ {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] allow_availability_zone_fallback = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] allow_compression_on_image_upload = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] allowed_direct_url_schemes = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] api_rate_limit = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] auth_strategy = keystone {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] az_cache_duration = 3600 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_availability_zone = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_host = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_stats_polling_interval = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backup_api_class = cinder.backup.api.API {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backup_name_template = backup-%s {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backup_use_same_host = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backup_use_temp_snapshot = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] chap_password = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] chap_username = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_internal_tenant_project_id = dae247aed7a7445b8bc99b8e5af5abe2 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_internal_tenant_user_id = 6d7060c8f21642f08ed7bada901e4c36 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cloned_volume_same_az = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cluster = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] compression_format = gzip {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] compute_api_class = cinder.compute.nova.API {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] config_dir = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] config_source = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] control_exchange = openstack {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] debug = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] default_availability_zone = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] default_group_type = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] default_volume_type = lvmdriver-1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] disk_geometry = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] driver_client_cert = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] driver_client_cert_key = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] driver_data_namespace = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] driver_ssl_cert_path = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] driver_ssl_cert_verify = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] driver_use_ssl = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] enable_force_upload = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] enable_new_services = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] enable_unsupported_driver = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] enforce_multipath_for_image_xfer = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] filter_function = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_api_insecure = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_api_servers = ['http://192.168.122.41/image'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_api_ssl_compression = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_ca_certificates_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_catalog_info = image:glance:publicURL {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_num_retries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance_request_timeout = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] goodness_function = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] graceful_shutdown_timeout = 5 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] group_api_class = cinder.group.api.API {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] host = devstack {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_compress_on_upload = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_conversion_address_space_limit = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[75004]: INFO cinder.volume.manager [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_conversion_cpu_limit = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_conversion_disable = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_introspection_address_space_limit = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_introspection_cpu_limit = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_upload_use_cinder_backend = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_upload_use_internal_tenant = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_volume_cache_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_volume_cache_max_count = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] image_volume_cache_max_size_gb = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] init_host_max_objects_retrieval = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] instance_format = [instance: %(uuid)s] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] iscsi_target_flags = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] iscsi_write_cache = on {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] iser_helper = tgtadm {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] iser_ip_address = 192.168.122.41 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] iser_port = 3260 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_color = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_config_append = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_dir = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_options = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_rotate_interval = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_rotate_interval_type = days {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] log_rotation_type = none {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] max_age = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] max_logfile_count = 30 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] max_logfile_size_mb = 200 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] max_over_subscription_ratio = 20.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] message_reap_interval = 86400 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] message_ttl = 2592000 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] migration_create_volume_timeout_secs = 300 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] monkey_patch = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] monkey_patch_modules = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] my_ip = 192.168.122.41 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] no_snapshot_gb_quota = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] num_iser_scan_tries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] num_shell_tries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] num_volume_device_scan_tries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] nvmeof_conn_info_version = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] nvmet_ns_id = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] nvmet_port_id = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] osapi_max_limit = 1000 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] osapi_volume_ext_list = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] osapi_volume_listen_port = 8776 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] osapi_volume_use_ssl = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] osapi_volume_workers = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] per_volume_size_limit = -1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] periodic_fuzzy_delay = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] periodic_interval = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] public_endpoint = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] publish_errors = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] quota_backup_gigabytes = 1000 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] quota_backups = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] quota_gigabytes = 1000 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] quota_groups = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] quota_snapshots = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] quota_volumes = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] rate_limit_burst = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] rate_limit_except_level = CRITICAL {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] rate_limit_interval = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] reinit_driver_count = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] replication_device = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] report_discard_supported = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] report_interval = 120 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] reservation_clean_interval = 86400 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] reservation_expire = 86400 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] reserved_image_namespaces = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] reserved_percentage = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] rpc_response_timeout = 120 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] run_external_periodic_tasks = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] scst_target_driver = iscsi {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] scst_target_iqn_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_down_time = 720 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] shell_completion = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] snapshot_name_template = snapshot-%s {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] snapshot_same_host = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] split_loggers = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] state_path = /opt/stack/data/cinder {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] storage_availability_zone = nova {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] storage_protocol = iSCSI {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] syslog_log_facility = LOG_USER {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] target_helper = lioadm {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] target_ip_address = 192.168.122.41 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] target_port = 3260 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] target_protocol = iscsi {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] target_secondary_ip_addresses = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] trace_flags = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] transport_url = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] until_refresh = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] use_chap_auth = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] use_default_quota_class = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] use_journal = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] use_json = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] use_multipath_for_image_xfer = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] use_stderr = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] use_syslog = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] verify_glance_signatures = enabled {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_api_class = cinder.volume.api.API {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_backend_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_clear = zero {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_clear_ionice = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_clear_size = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_copy_bps_limit = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_dd_blocksize = 1M {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_name_template = volume-%s {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_service_inithost_offload = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volume_usage_audit_period = month {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] zoning_mode = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_concurrency.disable_process_locking = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:14 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.auth_section = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.auth_type = password {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.auth_version = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.cache = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.include_service_catalog = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.insecure = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.interface = public {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_password = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack sudo[75010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcache_username = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.region_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack sudo[75010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.service_type = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.backend = dogpile.cache.null {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.backend_argument = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.backend_expiration_time = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.config_prefix = cache.oslo {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.debug_cache_backend = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.enable_retry_client = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.enable_socket_keepalive = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.expiration_time = 600 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.hashclient_retry_attempts = 2 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.memcache_dead_retry = 300 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.memcache_pool_maxsize = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.memcache_sasl_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.password = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.proxies = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.redis_db = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.redis_server = localhost:6379 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.retry_attempts = 2 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.retry_delay = 0.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.socket_keepalive_count = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.socket_keepalive_idle = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.socket_keepalive_interval = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.socket_timeout = 1.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.tls_allowed_ciphers = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.tls_cafile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.tls_certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.tls_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.tls_keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cache.username = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] coordination.backend_url = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.asyncio_connection = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.asyncio_slave_connection = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.backend = sqlalchemy {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.connection = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.connection_debug = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.connection_parameters = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.connection_recycle_time = 3600 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.connection_trace = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.db_inc_retry_interval = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.db_max_retries = 20 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.db_max_retry_interval = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.db_retry_interval = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.max_overflow = 50 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.max_pool_size = 5 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.max_retries = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.mysql_wsrep_sync_wait = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.pool_timeout = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.retry_interval = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.slave_connection = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.sqlite_synchronous = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.synchronous_reader = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] database.use_db_reconnect = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_tracing.insecure = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.connection_string = messaging:// {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.es_doc_type = notification {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.es_scroll_size = 10000 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.es_scroll_time = 2m {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.filter_error_trace = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.hmac_keys = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.sentinel_service_name = mymaster {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.socket_timeout = 0.1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.trace_requests = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler.trace_sqlalchemy = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler_jaeger.process_tags = {} {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler_jaeger.service_name_prefix = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] profiler_otlp.service_name_prefix = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.enforce_new_defaults = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.policy_default_rule = default {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.policy_file = policy.yaml {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] privsep_osbrick.group = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] privsep_osbrick.helper_command = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] privsep_osbrick.user = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_sys_admin.group = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_sys_admin.helper_command = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] cinder_sys_admin.user = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.auth_section = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.auth_type = password {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.cafile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.collect_timing = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.insecure = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.send_service_user_token = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.split_loggers = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.timeout = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.tls_ciphers = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] service_user.tls_min_version = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.auth_section = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.auth_type = password {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.collect_timing = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.insecure = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.region_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.split_loggers = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.timeout = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.tls_ciphers = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] glance.tls_min_version = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.backend_availability_zone = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.chap_password = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.chap_username = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.disk_geometry = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.driver_client_cert = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.driver_client_cert_key = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.driver_data_namespace = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.driver_use_ssl = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.extra_capabilities = {} {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.filter_function = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.goodness_function = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.iscsi_target_flags = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.iscsi_write_cache = on {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.iser_helper = tgtadm {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.iser_port = 3260 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.lvm_share_target = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.lvm_type = auto {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.num_shell_tries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.replication_device = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.report_discard_supported = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.reserved_percentage = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.target_helper = tgtadm {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.target_port = 3260 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.target_protocol = iscsi {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.trace_flags = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.unique_fqdn_network = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.use_chap_auth = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_backend_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_clear = zero {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_clear_ionice = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_clear_size = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_reports.file_event_handler = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_reports.log_dir = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.backend_host = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.chap_password = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.chap_username = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.disk_geometry = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.driver_client_cert = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.extra_capabilities = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.filter_function = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.goodness_function = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.iser_helper = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.iser_ip_address = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.iser_port = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.lvm_share_target = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.lvm_type = auto {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.num_shell_tries = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.replication_device = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.report_discard_supported = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.reserved_percentage = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.scst_target_driver = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.storage_protocol = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.target_helper = lioadm {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.target_ip_address = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.target_port = 3260 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.trace_flags = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.use_chap_auth = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_clear = zero {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_clear_size = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] lvmdriver-1.volumes_dir = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.ssl = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_notifications.driver = [] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_notifications.retry = -1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] key_manager.fixed_key = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.barbican_api_version = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.barbican_endpoint = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.barbican_endpoint_type = public {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.barbican_region_name = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.cafile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.collect_timing = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.insecure = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.number_of_retries = 60 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.retry_delay = 1 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.send_service_user_token = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.split_loggers = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.timeout = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.tls_ciphers = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.tls_min_version = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.verify_ssl = True {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican.verify_ssl_path = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.auth_section = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.auth_type = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.cafile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.certfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.collect_timing = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.insecure = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.keyfile = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.split_loggers = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.timeout = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.tls_ciphers = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] barbican_service_user.tls_min_version = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.approle_role_id = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.approle_secret_id = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.auth_method = approle {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.auth_path = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.kv_mountpoint = secret {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.kv_path = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.kv_version = 2 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.namespace = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.root_token_id = **** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.ssl_ca_crt_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.timeout = 60.0 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.token_file = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.token_role = None {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.use_ssl = False {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:53:14 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] ******************************************************************************** {{(pid=74860) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:53:15 devstack sudo[75010]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:15 devstack sudo[75018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:15 devstack sudo[75018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:15 devstack sudo[75018]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.286s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 14:53:15 devstack cinder-volume[75004]: INFO cinder.brick.local_dev.lvm [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:15 devstack sudo[75088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:15 devstack sudo[75088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:15 devstack sudo[75088]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG cinder.brick.local_dev.lvm [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75004) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 14:53:15 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:15 devstack sudo[75194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:15 devstack sudo[75194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:16 devstack sudo[75194]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.559s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:16 devstack sudo[75382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:16 devstack sudo[75382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:16 devstack sudo[75382]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:16 devstack sudo[75488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 14:53:16 devstack sudo[75488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:16 devstack sudo[75488]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.317s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:16 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:16 devstack sudo[75567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:16 devstack sudo[75567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:17 devstack sudo[75567]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:17 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:17 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:17 devstack sudo[75628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:17 devstack sudo[75628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:17 devstack sudo[75628]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:17 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:17 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:17 devstack sudo[75636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:17 devstack sudo[75636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:17 devstack sudo[75636]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:17 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:17 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:17 devstack sudo[75715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:17 devstack sudo[75715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:18 devstack sudo[75715]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:18 devstack sudo[75726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:18 devstack sudo[75726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:18 devstack sudo[75726]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.396s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack cinder-volume[75004]: INFO cinder.volume.drivers.lvm [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:18 devstack sudo[75810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:18 devstack sudo[75810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:18 devstack sudo[75810]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.321s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG cinder.volume.drivers.lvm [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Updating volume stats {{(pid=75004) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:18 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:18 devstack sudo[75815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:18 devstack sudo[75815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:19 devstack sudo[75815]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:19 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.338s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:19 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:19 devstack sudo[75822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:19 devstack sudo[75822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:19 devstack sudo[75822]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:19 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:19 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:19 devstack sudo[75825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:19 devstack sudo[75825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:19 devstack sudo[75825]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:19 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:19 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:19 devstack sudo[75829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:19 devstack sudo[75829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:20 devstack sudo[75829]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:20 devstack cinder-volume[75004]: INFO cinder.volume.driver [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG cinder.volume.driver [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75004) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG oslo_db.sqlalchemy.engines [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75004) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG dbcounter [-] [75004] Writer thread running {{(pid=75004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG cinder.db.api [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Building query based on filter {{(pid=75004) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG cinder.image.image_utils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75004) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:53:20 devstack cinder-volume[75004]: INFO cinder.keymgr.migration [None req-60bb7f1c-82d8-4462-9520-1e3c1900cbff None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG cinder.volume.drivers.lvm [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Updating volume stats {{(pid=75004) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:20 devstack sudo[75833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:20 devstack sudo[75833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:20 devstack sudo[75833]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:20 devstack sudo[75837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:20 devstack sudo[75837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:20 devstack sudo[75837]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:20 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:20 devstack sudo[75841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:20 devstack sudo[75841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:21 devstack sudo[75841]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.317s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:21 devstack sudo[75844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:21 devstack sudo[75844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:21 devstack sudo[75844]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.345s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG cinder.manager [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Notifying Schedulers of capabilities ... {{(pid=75004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:53:21 devstack cinder-volume[75004]: INFO cinder.volume.manager [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Driver initialization completed successfully. Sep 28 14:53:21 devstack cinder-volume[75004]: INFO cinder.manager [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Initiating service 2 cleanup Sep 28 14:53:21 devstack cinder-volume[75004]: INFO cinder.manager [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Service 2 cleanup completed. Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG cinder.service [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Creating RPC server for service cinder-volume {{(pid=75004) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG cinder.service [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75004) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:53:21 devstack cinder-volume[75004]: INFO cinder.volume.manager [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG cinder.volume.drivers.lvm [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Updating volume stats {{(pid=75004) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:53:21 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:21 devstack sudo[75847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:53:21 devstack sudo[75847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:22 devstack sudo[75847]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:22 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:22 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:22 devstack sudo[75851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:22 devstack sudo[75851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:22 devstack sudo[75851]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:22 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:22 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:22 devstack sudo[75858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:53:22 devstack sudo[75858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:22 devstack sudo[75858]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:22 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:22 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:53:22 devstack sudo[75862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:53:22 devstack sudo[75862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:53:22 devstack sudo[75862]: pam_unix(sudo:session): session closed for user root Sep 28 14:53:22 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:53:22 devstack cinder-volume[75004]: INFO cinder.volume.manager [None req-25c50287-2c16-4c48-a8fe-3db2ed3b1830 None None] Driver post RPC initialization completed successfully. Sep 28 14:53:24 devstack cinder-volume[74860]: DEBUG dbcounter [-] [74860] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74860) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:31 devstack cinder-volume[75004]: DEBUG dbcounter [-] [75004] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:32 devstack cinder-volume[75004]: DEBUG dbcounter [-] [75004] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:53:46 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager._thread_info {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:53:46 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread count: 6 {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:53:46 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread info: [<_MainThread(MainThread, started 128605956522112)>, , , , , ] {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:54:46 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:46 devstack cinder-volume[75004]: DEBUG cinder.volume.drivers.lvm [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Updating volume stats {{(pid=75004) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:54:46 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:46 devstack sudo[78386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:54:46 devstack sudo[78386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:47 devstack sudo[78386]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:47 devstack sudo[78391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:47 devstack sudo[78391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:47 devstack sudo[78391]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:47 devstack sudo[78394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:54:47 devstack sudo[78394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:47 devstack sudo[78394]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:54:47 devstack sudo[78397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:54:47 devstack sudo[78397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:54:48 devstack sudo[78397]: pam_unix(sudo:session): session closed for user root Sep 28 14:54:48 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:54:48 devstack cinder-volume[75004]: DEBUG cinder.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Notifying Schedulers of capabilities ... {{(pid=75004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:54:48 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager._thread_info {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:54:48 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread count: 6 {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:54:48 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread info: [<_MainThread(MainThread, started 128605956522112)>, , , , , ] {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:55:32 devstack cinder-volume[75004]: DEBUG dbcounter [-] [75004] Writing DB stats cinder:SELECT=1 {{(pid=75004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:55:32 devstack cinder-volume[75004]: DEBUG dbcounter [-] [75004] Writing DB stats cinder:UPDATE=1 {{(pid=75004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:55:46 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:46 devstack cinder-volume[75004]: DEBUG cinder.volume.drivers.lvm [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Updating volume stats {{(pid=75004) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:55:46 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:46 devstack sudo[81788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:55:46 devstack sudo[81788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:47 devstack sudo[81788]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:47 devstack sudo[81794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:47 devstack sudo[81794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:47 devstack sudo[81794]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:47 devstack sudo[81797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:55:47 devstack sudo[81797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:47 devstack sudo[81797]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:55:47 devstack sudo[81805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:55:47 devstack sudo[81805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:55:48 devstack sudo[81805]: pam_unix(sudo:session): session closed for user root Sep 28 14:55:48 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:55:48 devstack cinder-volume[75004]: DEBUG cinder.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Notifying Schedulers of capabilities ... {{(pid=75004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:55:48 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager._thread_info {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:55:48 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread count: 6 {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:55:48 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread info: [<_MainThread(MainThread, started 128605956522112)>, , , , , ] {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:56:46 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:56:46 devstack cinder-volume[75004]: DEBUG cinder.volume.drivers.lvm [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Updating volume stats {{(pid=75004) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:56:46 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:46 devstack sudo[83784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:56:46 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:47 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:47 devstack sudo[83805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:56:47 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:47 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:47 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:56:47 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:47 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:56:47 devstack sudo[83822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:56:47 devstack sudo[83822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:56:48 devstack sudo[83822]: pam_unix(sudo:session): session closed for user root Sep 28 14:56:48 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:56:48 devstack cinder-volume[75004]: DEBUG cinder.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Notifying Schedulers of capabilities ... {{(pid=75004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:32 devstack cinder-volume[75004]: DEBUG dbcounter [-] [75004] Writing DB stats cinder:SELECT=1 {{(pid=75004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:32 devstack cinder-volume[75004]: DEBUG dbcounter [-] [75004] Writing DB stats cinder:UPDATE=1 {{(pid=75004) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:57:46 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:46 devstack cinder-volume[75004]: DEBUG cinder.volume.drivers.lvm [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Updating volume stats {{(pid=75004) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 14:57:46 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:46 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 14:57:46 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:47 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:47 devstack sudo[84865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:57:47 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:47 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:47 devstack sudo[84868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 14:57:47 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:47 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:47 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:57:47 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 14:57:47 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:57:48 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Sep 28 14:57:48 devstack cinder-volume[75004]: DEBUG oslo_concurrency.processutils [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75004) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:57:48 devstack cinder-volume[75004]: DEBUG cinder.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Notifying Schedulers of capabilities ... {{(pid=75004) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:57:48 devstack cinder-volume[75004]: DEBUG oslo_service.periodic_task [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] Running periodic task VolumeManager._thread_info {{(pid=75004) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:57:48 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread count: 6 {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:57:48 devstack cinder-volume[75004]: DEBUG cinder.volume.manager [None req-11f0e4d3-f45a-4827-acd0-ecbdce30b141 None None] thread info: [<_MainThread(MainThread, started 128605956522112)>, , , , , ] {{(pid=75004) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:58:09 devstack cinder-volume[74860]: INFO oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Caught SIGTERM, stopping children Sep 28 14:58:09 devstack cinder-volume[74860]: DEBUG oslo_concurrency.lockutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Acquiring lock "singleton_lock" {{(pid=74860) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:09 devstack cinder-volume[74860]: DEBUG oslo_concurrency.lockutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Acquired lock "singleton_lock" {{(pid=74860) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:09 devstack cinder-volume[74860]: DEBUG oslo_concurrency.lockutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Releasing lock "singleton_lock" {{(pid=74860) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:09 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Stop services. {{(pid=74860) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:58:09 devstack cinder-volume[74860]: DEBUG oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Killing children. {{(pid=74860) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:58:09 devstack cinder-volume[74860]: INFO oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Waiting on 1 children to exit Sep 28 14:58:11 devstack cinder-volume[75004]: DEBUG oslo_concurrency.lockutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Acquiring lock "singleton_lock" {{(pid=75004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:11 devstack cinder-volume[75004]: DEBUG oslo_concurrency.lockutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Acquired lock "singleton_lock" {{(pid=75004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:11 devstack cinder-volume[75004]: DEBUG oslo_concurrency.lockutils [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Releasing lock "singleton_lock" {{(pid=75004) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:11 devstack cinder-volume[75004]: WARNING amqp [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:11 devstack cinder-volume[75004]: WARNING amqp [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:11 devstack cinder-volume[74860]: INFO oslo_service.backend._eventlet.service [None req-eddb9339-ea15-4850-987b-0cbef4c57979 None None] Child 75004 exited with status 0 Sep 28 14:58:12 devstack cinder-volume[85432]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:58:12 devstack cinder-volume[85432]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:58:12 devstack cinder-volume[85432]: we strongly recommend against using it for new projects. Sep 28 14:58:12 devstack cinder-volume[85432]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:58:12 devstack cinder-volume[85432]: framework. For more detail see Sep 28 14:58:12 devstack cinder-volume[85432]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:58:12 devstack cinder-volume[85432]: import eventlet # noqa Sep 28 14:58:14 devstack cinder-volume[85432]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:14 devstack cinder-volume[85432]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:14 devstack cinder-volume[85432]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:15 devstack cinder-volume[85432]: INFO dbcounter [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Registered counter for database cinder Sep 28 14:58:15 devstack cinder-volume[85432]: DEBUG oslo_db.sqlalchemy.engines [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:15 devstack cinder-volume[85432]: DEBUG dbcounter [-] [85432] Writer thread running {{(pid=85432) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:15 devstack cinder-volume[85432]: INFO cinder.rpc [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:58:15 devstack cinder-volume[85432]: INFO cinder.rpc [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:58:15 devstack cinder-volume[85432]: DEBUG oslo_db.sqlalchemy.engines [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:16 devstack cinder-volume[85432]: INFO cinder.volume.manager [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Determined volume DB was empty at startup. Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG cinder.volume.manager [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85432) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:58:16 devstack cinder-volume[85432]: INFO cinder.volume.manager [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 14:58:16 devstack cinder-volume[85432]: WARNING stevedore.named [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:58:16 devstack cinder-volume[85432]: WARNING castellan.key_manager [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:16 devstack cinder-volume[85432]: WARNING cinder.keymgr.conf_key_mgr [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:16 devstack cinder-volume[85432]: INFO cinder.volume.manager [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_db.sqlalchemy.engines [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85432) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:16 devstack cinder-volume[85432]: INFO oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Starting 1 workers Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Started child 85654 {{(pid=85432) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Full set of CONF: {{(pid=85432) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] ******************************************************************************** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Configuration options gathered from: {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] ================================================================================ {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] allow_availability_zone_fallback = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] allow_compression_on_image_upload = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] allowed_direct_url_schemes = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85654]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] api_rate_limit = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] auth_strategy = keystone {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_availability_zone = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_host = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_stats_polling_interval = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backup_api_class = cinder.backup.api.API {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backup_name_template = backup-%s {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backup_use_same_host = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backup_use_temp_snapshot = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] chap_password = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] chap_username = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_internal_tenant_project_id = dae247aed7a7445b8bc99b8e5af5abe2 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_internal_tenant_user_id = 6d7060c8f21642f08ed7bada901e4c36 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cluster = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] compression_format = gzip {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] compute_api_class = cinder.compute.nova.API {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] config_dir = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] config_source = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] control_exchange = openstack {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] debug = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] default_availability_zone = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] default_group_type = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] default_volume_type = QuobyteHD {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] disk_geometry = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] driver_client_cert = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] driver_client_cert_key = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] driver_data_namespace = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] driver_ssl_cert_path = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] driver_ssl_cert_verify = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] driver_use_ssl = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] enable_new_services = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] enable_unsupported_driver = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] enabled_backends = ['QuobyteHD'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] enforce_multipath_for_image_xfer = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] filter_function = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_api_insecure = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_api_servers = ['http://192.168.122.41/image'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_api_ssl_compression = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_ca_certificates_file = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_catalog_info = image:glance:publicURL {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_num_retries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance_request_timeout = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] goodness_function = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] graceful_shutdown_timeout = 5 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] group_api_class = cinder.group.api.API {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] host = devstack {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_compress_on_upload = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_conversion_address_space_limit = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_conversion_cpu_limit = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_conversion_disable = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_introspection_address_space_limit = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_introspection_cpu_limit = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_upload_use_cinder_backend = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_upload_use_internal_tenant = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_volume_cache_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_volume_cache_max_count = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] image_volume_cache_max_size_gb = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] init_host_max_objects_retrieval = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] instance_format = [instance: %(uuid)s] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] iscsi_target_flags = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] iscsi_write_cache = on {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] iser_helper = tgtadm {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] iser_ip_address = 192.168.122.41 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] iser_port = 3260 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_color = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_config_append = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_dir = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_file = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_options = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_rotate_interval = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_rotate_interval_type = days {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] log_rotation_type = none {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] max_age = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] max_logfile_count = 30 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] max_logfile_size_mb = 200 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] max_over_subscription_ratio = 20.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] message_reap_interval = 86400 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] message_ttl = 2592000 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85654]: INFO cinder.volume.manager [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.remotefs [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85654) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] migration_create_volume_timeout_secs = 300 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] monkey_patch = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] monkey_patch_modules = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] my_ip = 192.168.122.41 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] no_snapshot_gb_quota = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] num_iser_scan_tries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] num_shell_tries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] num_volume_device_scan_tries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] nvmeof_conn_info_version = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] nvmet_ns_id = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] nvmet_port_id = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] osapi_max_limit = 1000 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] osapi_volume_ext_list = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] osapi_volume_listen_port = 8776 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] osapi_volume_use_ssl = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] osapi_volume_workers = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] per_volume_size_limit = -1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] periodic_fuzzy_delay = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] periodic_interval = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] public_endpoint = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] publish_errors = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] quota_backup_gigabytes = 1000 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] quota_backups = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] quota_gigabytes = 1000 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] quota_groups = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] quota_snapshots = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] quota_volumes = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] rate_limit_burst = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] rate_limit_except_level = CRITICAL {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] rate_limit_interval = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] reinit_driver_count = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] replication_device = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] report_discard_supported = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] report_interval = 120 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] reservation_clean_interval = 86400 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] reservation_expire = 86400 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] reserved_image_namespaces = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] reserved_percentage = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] rpc_response_timeout = 120 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] run_external_periodic_tasks = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] scst_target_driver = iscsi {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] scst_target_iqn_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_down_time = 720 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] shell_completion = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] snapshot_name_template = snapshot-%s {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] split_loggers = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] state_path = /opt/stack/data/cinder {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] storage_availability_zone = nova {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] storage_protocol = iSCSI {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] syslog_log_facility = LOG_USER {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] target_helper = lioadm {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] target_ip_address = 192.168.122.41 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] target_port = 3260 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] target_protocol = iscsi {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] target_secondary_ip_addresses = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] trace_flags = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] transport_url = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] until_refresh = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] use_chap_auth = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] use_default_quota_class = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] use_journal = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] use_json = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] use_multipath_for_image_xfer = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] use_stderr = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] use_syslog = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] verify_glance_signatures = enabled {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_api_class = cinder.volume.api.API {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_backend_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_clear = zero {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_clear_ionice = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_clear_size = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_copy_bps_limit = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_dd_blocksize = 1M {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_name_template = volume-%s {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_service_inithost_offload = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volume_usage_audit_period = month {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] zoning_mode = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_concurrency.disable_process_locking = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85654) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:58:16 devstack cinder-volume[85654]: WARNING cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:58:16 devstack cinder-volume[85654]: WARNING cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.auth_section = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.auth_type = password {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.auth_version = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.cache = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Running cmd (subprocess): mount.quobyte {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.include_service_catalog = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.insecure = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.interface = public {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_password = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcache_username = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.region_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.service_type = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.backend = dogpile.cache.null {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.backend_argument = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.backend_expiration_time = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.config_prefix = cache.oslo {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.debug_cache_backend = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.enable_retry_client = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.enable_socket_keepalive = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.expiration_time = 600 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.hashclient_retry_attempts = 2 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.memcache_dead_retry = 300 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.memcache_pool_maxsize = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.memcache_sasl_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.password = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.proxies = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.redis_db = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.redis_server = localhost:6379 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.retry_attempts = 2 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.retry_delay = 0.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.socket_keepalive_count = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.socket_keepalive_idle = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.socket_keepalive_interval = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.socket_timeout = 1.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.tls_allowed_ciphers = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.tls_cafile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.tls_certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.tls_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.tls_keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cache.username = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] coordination.backend_url = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.asyncio_connection = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.asyncio_slave_connection = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.backend = sqlalchemy {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.connection = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.connection_debug = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.connection_parameters = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.connection_recycle_time = 3600 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.connection_trace = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.db_inc_retry_interval = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.db_max_retries = 20 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.db_max_retry_interval = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.db_retry_interval = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.max_overflow = 50 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.max_pool_size = 5 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.max_retries = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.mysql_wsrep_sync_wait = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.pool_timeout = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.retry_interval = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.slave_connection = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.sqlite_synchronous = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.synchronous_reader = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] database.use_db_reconnect = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_tracing.insecure = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.connection_string = messaging:// {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.es_doc_type = notification {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.es_scroll_size = 10000 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.es_scroll_time = 2m {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.filter_error_trace = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.hmac_keys = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.sentinel_service_name = mymaster {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.socket_timeout = 0.1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.trace_requests = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler.trace_sqlalchemy = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler_jaeger.process_tags = {} {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler_jaeger.service_name_prefix = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] profiler_otlp.service_name_prefix = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.enforce_new_defaults = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.policy_default_rule = default {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.policy_file = policy.yaml {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] privsep_osbrick.group = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] privsep_osbrick.helper_command = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] privsep_osbrick.user = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_sys_admin.group = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_sys_admin.helper_command = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] cinder_sys_admin.user = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.auth_section = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.auth_type = password {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.cafile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.collect_timing = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.insecure = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.send_service_user_token = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.split_loggers = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.timeout = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.tls_ciphers = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] service_user.tls_min_version = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.auth_section = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.auth_type = password {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.collect_timing = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.insecure = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.region_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.split_loggers = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.timeout = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.tls_ciphers = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] glance.tls_min_version = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.backend_availability_zone = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.chap_password = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.chap_username = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.disk_geometry = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.driver_client_cert = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.driver_client_cert_key = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.driver_data_namespace = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.driver_use_ssl = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.extra_capabilities = {} {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.filter_function = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.goodness_function = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.iscsi_target_flags = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.iscsi_write_cache = on {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.iser_helper = tgtadm {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.iser_port = 3260 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack quobyte-client[85659]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_host = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_login = admin {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack quobyte-client[85659]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_mount_options = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_password = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_private_key = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_share_path = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] CMD "mount.quobyte" returned: 1 in 0.132s {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.num_shell_tries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=85654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:16 devstack cinder-volume[85654]: INFO cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 ... Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 -c /etc/quobyte/client-cinder.cfg {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.quobyte_volume_url = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.replication_device = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.report_discard_supported = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.reserved_percentage = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.target_helper = tgtadm {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.target_port = 3260 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.target_protocol = iscsi {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.trace_flags = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.unique_fqdn_network = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.use_chap_auth = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_backend_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_clear = zero {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_clear_ionice = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_clear_size = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 -c /etc/quobyte/client-cinder.cfg Sep 28 14:58:16 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_reports.file_event_handler = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_reports.log_dir = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.backend_availability_zone = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.backend_host = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.chap_password = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.chap_username = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.chiscsi_conf = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.disk_geometry = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.driver_client_cert = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.driver_data_namespace = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.driver_use_ssl = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.extra_capabilities = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.filter_function = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.goodness_function = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.iser_helper = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.iser_ip_address = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.iser_port = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.iser_target_prefix = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_host = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_login = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_mount_options = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_password = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_private_key = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_share_path = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_ssh_port = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.num_shell_tries = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.nvmet_port_id = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.replication_device = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.report_discard_supported = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.reserved_percentage = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.scst_target_driver = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.storage_protocol = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.target_helper = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.target_ip_address = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.target_port = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.target_prefix = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.target_protocol = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.trace_flags = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.use_chap_auth = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_clear = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_clear_size = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] QuobyteHD.volumes_dir = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.ssl = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_notifications.driver = [] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_notifications.retry = -1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] key_manager.fixed_key = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.barbican_api_version = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.barbican_endpoint = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.barbican_endpoint_type = public {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.barbican_region_name = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.cafile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.collect_timing = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.insecure = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.number_of_retries = 60 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.retry_delay = 1 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.send_service_user_token = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.split_loggers = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.timeout = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.tls_ciphers = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.tls_min_version = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.verify_ssl = True {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican.verify_ssl_path = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.auth_section = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.auth_type = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.cafile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.certfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.collect_timing = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.insecure = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.keyfile = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.split_loggers = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.timeout = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.tls_ciphers = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] barbican_service_user.tls_min_version = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.approle_role_id = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.approle_secret_id = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.auth_method = approle {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.auth_path = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.kv_mountpoint = secret {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.kv_path = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.kv_version = 2 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.namespace = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.root_token_id = **** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.ssl_ca_crt_file = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.timeout = 60.0 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.token_file = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.token_role = None {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.use_ssl = False {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:16 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] ******************************************************************************** {{(pid=85432) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:58:17 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.489s {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:17 devstack cinder-volume[85654]: INFO cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 succeeded Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=85654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.503s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:17 devstack sudo[85762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:58:17 devstack sudo[85762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:17 devstack sudo[85762]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.316s {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:17 devstack cinder-volume[85654]: INFO cinder.volume.driver [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.volume.driver [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85654) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_db.sqlalchemy.engines [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG dbcounter [-] [85654] Writer thread running {{(pid=85654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.db.api [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Building query based on filter {{(pid=85654) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.image.image_utils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85654) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:58:17 devstack cinder-volume[85654]: INFO cinder.keymgr.migration [None req-e7fc6f6d-ef93-4d9d-b64a-848d5fddd8a8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=85654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=85654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:17 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:58:17 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:17 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.271s {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.manager [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Notifying Schedulers of capabilities ... {{(pid=85654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:17 devstack cinder-volume[85654]: INFO cinder.volume.manager [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Driver initialization completed successfully. Sep 28 14:58:17 devstack cinder-volume[85654]: INFO cinder.manager [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Initiating service 3 cleanup Sep 28 14:58:17 devstack cinder-volume[85654]: INFO cinder.manager [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Service 3 cleanup completed. Sep 28 14:58:17 devstack cinder-volume[85654]: DEBUG cinder.service [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Creating RPC server for service cinder-volume {{(pid=85654) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG cinder.service [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85654) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:58:18 devstack cinder-volume[85654]: INFO cinder.volume.manager [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=85654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=85654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:18 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:58:18 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:18 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:18 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.283s {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:18 devstack cinder-volume[85654]: INFO cinder.volume.manager [None req-851811e1-9ebb-4575-8897-a8d289b419be None None] Driver post RPC initialization completed successfully. Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=85654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG cinder.volume.drivers.quobyte [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=85654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:23 devstack sudo[85890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:58:23 devstack sudo[85890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:23 devstack sudo[85890]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG oslo_concurrency.processutils [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.266s {{(pid=85654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:23 devstack cinder-volume[85654]: DEBUG cinder.manager [None req-23772d3c-954d-48ca-a845-4489e0dfa853 None None] Notifying Schedulers of capabilities ... {{(pid=85654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:25 devstack cinder-volume[85432]: INFO oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Caught SIGTERM, stopping children Sep 28 14:58:25 devstack cinder-volume[85432]: DEBUG oslo_concurrency.lockutils [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Acquiring lock "singleton_lock" {{(pid=85432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:25 devstack cinder-volume[85432]: DEBUG oslo_concurrency.lockutils [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Acquired lock "singleton_lock" {{(pid=85432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:25 devstack cinder-volume[85432]: DEBUG oslo_concurrency.lockutils [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Releasing lock "singleton_lock" {{(pid=85432) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:25 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Stop services. {{(pid=85432) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 14:58:25 devstack cinder-volume[85432]: DEBUG oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Killing children. {{(pid=85432) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 14:58:25 devstack cinder-volume[85432]: INFO oslo_service.backend._eventlet.service [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Waiting on 1 children to exit Sep 28 14:58:28 devstack cinder-volume[85654]: DEBUG dbcounter [-] [85654] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:28 devstack cinder-volume[85654]: DEBUG dbcounter [-] [85654] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=85654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:30 devstack cinder-volume[85654]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 28 14:58:31 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Acquiring lock "singleton_lock" {{(pid=85654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:31 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Acquired lock "singleton_lock" {{(pid=85654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:31 devstack cinder-volume[85654]: DEBUG oslo_concurrency.lockutils [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Releasing lock "singleton_lock" {{(pid=85654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:31 devstack cinder-volume[85654]: WARNING amqp [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:31 devstack cinder-volume[85654]: WARNING amqp [None req-d8387749-3813-4eab-b74e-8285170cdcb0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 14:58:31 devstack cinder-volume[85989]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 14:58:31 devstack cinder-volume[85989]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 14:58:31 devstack cinder-volume[85989]: we strongly recommend against using it for new projects. Sep 28 14:58:31 devstack cinder-volume[85989]: If you are already using Eventlet, we recommend migrating to a different Sep 28 14:58:31 devstack cinder-volume[85989]: framework. For more detail see Sep 28 14:58:31 devstack cinder-volume[85989]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 14:58:31 devstack cinder-volume[85989]: import eventlet # noqa Sep 28 14:58:35 devstack cinder-volume[85989]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 14:58:35 devstack cinder-volume[85989]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 14:58:35 devstack cinder-volume[85989]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85989) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 14:58:35 devstack cinder-volume[85989]: INFO dbcounter [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Registered counter for database cinder Sep 28 14:58:35 devstack cinder-volume[85989]: DEBUG oslo_db.sqlalchemy.engines [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG dbcounter [-] [85989] Writer thread running {{(pid=85989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:36 devstack cinder-volume[85989]: INFO cinder.rpc [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 14:58:36 devstack cinder-volume[85989]: INFO cinder.rpc [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_db.sqlalchemy.engines [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:36 devstack cinder-volume[85989]: INFO cinder.volume.manager [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Determined volume DB was empty at startup. Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG cinder.volume.manager [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85989) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 14:58:36 devstack cinder-volume[85989]: WARNING stevedore.named [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 14:58:36 devstack cinder-volume[85989]: WARNING castellan.key_manager [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:36 devstack cinder-volume[85989]: WARNING cinder.keymgr.conf_key_mgr [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 14:58:36 devstack cinder-volume[85989]: INFO cinder.volume.manager [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_db.sqlalchemy.engines [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:36 devstack cinder-volume[85989]: INFO oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Starting 1 workers Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Started child 86301 {{(pid=85989) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Full set of CONF: {{(pid=85989) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] ******************************************************************************** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] Configuration options gathered from: {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] ================================================================================ {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] allow_availability_zone_fallback = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] allow_compression_on_image_upload = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] allowed_direct_url_schemes = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] api_rate_limit = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[86301]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] auth_strategy = keystone {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_availability_zone = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_host = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_stats_polling_interval = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backup_api_class = cinder.backup.api.API {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backup_name_template = backup-%s {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backup_use_same_host = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backup_use_temp_snapshot = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] chap_password = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] chap_username = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_internal_tenant_project_id = dae247aed7a7445b8bc99b8e5af5abe2 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_internal_tenant_user_id = 6d7060c8f21642f08ed7bada901e4c36 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cluster = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] compression_format = gzip {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] compute_api_class = cinder.compute.nova.API {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] config_dir = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] config_source = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] control_exchange = openstack {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] debug = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] default_availability_zone = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] default_group_type = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] default_volume_type = QuobyteHD {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] disk_geometry = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] driver_client_cert = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] driver_client_cert_key = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] driver_data_namespace = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] driver_ssl_cert_path = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] driver_ssl_cert_verify = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] driver_use_ssl = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] enable_new_services = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] enable_unsupported_driver = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] enabled_backends = ['QuobyteHD'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] enforce_multipath_for_image_xfer = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] filter_function = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_api_insecure = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_api_servers = ['http://192.168.122.41/image'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_api_ssl_compression = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_ca_certificates_file = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_catalog_info = image:glance:publicURL {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_num_retries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance_request_timeout = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] goodness_function = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] graceful_shutdown_timeout = 5 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] group_api_class = cinder.group.api.API {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] host = devstack {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_compress_on_upload = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_conversion_address_space_limit = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_conversion_cpu_limit = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_conversion_disable = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_introspection_address_space_limit = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_introspection_cpu_limit = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_upload_use_cinder_backend = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_upload_use_internal_tenant = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_volume_cache_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_volume_cache_max_count = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] image_volume_cache_max_size_gb = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] init_host_max_objects_retrieval = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] instance_format = [instance: %(uuid)s] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] iscsi_target_flags = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] iscsi_write_cache = on {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] iser_helper = tgtadm {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] iser_ip_address = 192.168.122.41 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] iser_port = 3260 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_color = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_config_append = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_dir = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_file = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_options = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_rotate_interval = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_rotate_interval_type = days {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] log_rotation_type = none {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] max_age = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] max_logfile_count = 30 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] max_logfile_size_mb = 200 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] max_over_subscription_ratio = 20.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] message_reap_interval = 86400 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] message_ttl = 2592000 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] migration_create_volume_timeout_secs = 300 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] monkey_patch = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] monkey_patch_modules = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] my_ip = 192.168.122.41 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] no_snapshot_gb_quota = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] num_iser_scan_tries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] num_shell_tries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] num_volume_device_scan_tries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] nvmeof_conn_info_version = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] nvmet_ns_id = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] nvmet_port_id = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] osapi_max_limit = 1000 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] osapi_volume_ext_list = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] osapi_volume_listen_port = 8776 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] osapi_volume_use_ssl = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] osapi_volume_workers = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] per_volume_size_limit = -1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] periodic_fuzzy_delay = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] periodic_interval = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] public_endpoint = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] publish_errors = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] quota_backup_gigabytes = 1000 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] quota_backups = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] quota_gigabytes = 1000 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] quota_groups = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] quota_snapshots = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] quota_volumes = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] rate_limit_burst = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] rate_limit_except_level = CRITICAL {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] rate_limit_interval = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] reinit_driver_count = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] replication_device = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] report_discard_supported = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] report_interval = 120 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] reservation_clean_interval = 86400 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] reservation_expire = 86400 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] reserved_image_namespaces = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] reserved_percentage = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] rpc_response_timeout = 120 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] run_external_periodic_tasks = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] scst_target_driver = iscsi {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] scst_target_iqn_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_down_time = 720 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] shell_completion = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] snapshot_name_template = snapshot-%s {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] split_loggers = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] state_path = /opt/stack/data/cinder {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] storage_availability_zone = nova {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] storage_protocol = iSCSI {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] syslog_log_facility = LOG_USER {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] target_helper = lioadm {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] target_ip_address = 192.168.122.41 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] target_port = 3260 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] target_protocol = iscsi {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] target_secondary_ip_addresses = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] trace_flags = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86301) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] transport_url = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] until_refresh = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] use_chap_auth = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] use_default_quota_class = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] use_journal = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] use_json = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] use_multipath_for_image_xfer = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] use_stderr = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] use_syslog = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] verify_glance_signatures = enabled {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_api_class = cinder.volume.api.API {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_backend_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_clear = zero {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_clear_ionice = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_clear_size = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_copy_bps_limit = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_dd_blocksize = 1M {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_name_template = volume-%s {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_service_inithost_offload = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volume_usage_audit_period = month {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] zoning_mode = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_concurrency.disable_process_locking = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.auth_section = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.auth_type = password {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.auth_version = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.cache = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.include_service_catalog = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.insecure = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.interface = public {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_password = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcache_username = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.region_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.service_type = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.41/identity {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.backend = dogpile.cache.null {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.backend_argument = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.backend_expiration_time = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.config_prefix = cache.oslo {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.debug_cache_backend = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.enable_retry_client = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.enable_socket_keepalive = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.expiration_time = 600 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.hashclient_retry_attempts = 2 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.memcache_dead_retry = 300 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.memcache_pool_maxsize = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.memcache_sasl_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.password = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.proxies = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.redis_db = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.redis_server = localhost:6379 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.retry_attempts = 2 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.retry_delay = 0.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.socket_keepalive_count = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.socket_keepalive_idle = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.socket_keepalive_interval = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.socket_timeout = 1.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.tls_allowed_ciphers = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.tls_cafile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.tls_certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.tls_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.tls_keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cache.username = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] coordination.backend_url = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.asyncio_connection = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.asyncio_slave_connection = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.backend = sqlalchemy {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.connection = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.connection_debug = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.connection_parameters = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.connection_recycle_time = 3600 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.connection_trace = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.db_inc_retry_interval = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.db_max_retries = 20 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.db_max_retry_interval = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.db_retry_interval = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.max_overflow = 50 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.max_pool_size = 5 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.max_retries = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.mysql_wsrep_sync_wait = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.pool_timeout = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.retry_interval = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.slave_connection = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.sqlite_synchronous = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.synchronous_reader = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] database.use_db_reconnect = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_tracing.insecure = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.connection_string = messaging:// {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.es_doc_type = notification {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.es_scroll_size = 10000 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.es_scroll_time = 2m {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.filter_error_trace = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.hmac_keys = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.sentinel_service_name = mymaster {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.socket_timeout = 0.1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.trace_requests = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler.trace_sqlalchemy = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler_jaeger.process_tags = {} {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler_jaeger.service_name_prefix = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] profiler_otlp.service_name_prefix = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.enforce_new_defaults = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.policy_default_rule = default {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.policy_file = policy.yaml {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] privsep_osbrick.group = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] privsep_osbrick.helper_command = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] privsep_osbrick.user = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_sys_admin.group = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_sys_admin.helper_command = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] cinder_sys_admin.user = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.auth_section = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.auth_type = password {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.cafile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.collect_timing = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.insecure = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.send_service_user_token = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.split_loggers = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.timeout = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.tls_ciphers = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] service_user.tls_min_version = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.auth_section = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.auth_type = password {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.collect_timing = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.insecure = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.region_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.split_loggers = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.timeout = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.tls_ciphers = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] glance.tls_min_version = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.backend_availability_zone = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.chap_password = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.chap_username = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.disk_geometry = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.driver_client_cert = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.driver_client_cert_key = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.driver_data_namespace = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.driver_use_ssl = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86301) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 14:58:36 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 14:58:36 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.extra_capabilities = {} {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.filter_function = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.goodness_function = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Running cmd (subprocess): mount.quobyte {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.iscsi_target_flags = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.iscsi_write_cache = on {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.iser_helper = tgtadm {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.iser_ip_address = 192.168.122.41 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.iser_port = 3260 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_host = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_login = admin {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_mount_options = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_password = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_private_key = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_share_path = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.num_shell_tries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.quobyte_volume_url = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.replication_device = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.report_discard_supported = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.reserved_percentage = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.target_helper = tgtadm {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.target_ip_address = 192.168.122.41 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.target_port = 3260 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.target_protocol = iscsi {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.trace_flags = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.unique_fqdn_network = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.use_chap_auth = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_backend_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_clear = zero {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_clear_ionice = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_clear_size = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_reports.file_event_handler = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_reports.log_dir = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.backend_availability_zone = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.backend_host = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.chap_password = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.chap_username = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.chiscsi_conf = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.disk_geometry = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.driver_client_cert = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.driver_data_namespace = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.driver_use_ssl = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.extra_capabilities = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.filter_function = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.goodness_function = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.iser_helper = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.iser_ip_address = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.iser_port = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.iser_target_prefix = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_host = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_login = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_mount_options = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_password = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_private_key = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_share_path = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_ssh_port = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.num_shell_tries = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.nvmet_port_id = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.replication_device = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.report_discard_supported = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.reserved_percentage = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.scst_target_driver = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.storage_protocol = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.target_helper = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.target_ip_address = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.target_port = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.target_prefix = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.target_protocol = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.trace_flags = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.use_chap_auth = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_clear = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_clear_size = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] QuobyteHD.volumes_dir = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack quobyte-client[86308]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack quobyte-client[86308]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] CMD "mount.quobyte" returned: 1 in 0.095s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.ssl = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_notifications.driver = [] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_notifications.retry = -1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] key_manager.fixed_key = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.barbican_api_version = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.barbican_endpoint = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.barbican_endpoint_type = public {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.barbican_region_name = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.cafile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.collect_timing = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.insecure = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.number_of_retries = 60 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.retry_delay = 1 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.send_service_user_token = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.split_loggers = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.timeout = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.tls_ciphers = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.tls_min_version = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.verify_ssl = True {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican.verify_ssl_path = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.auth_section = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.auth_type = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.cafile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.certfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.collect_timing = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.insecure = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.keyfile = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.split_loggers = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.timeout = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.tls_ciphers = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] barbican_service_user.tls_min_version = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.approle_role_id = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.approle_secret_id = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.auth_method = approle {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.auth_path = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.kv_mountpoint = secret {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.kv_path = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.kv_version = 2 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.namespace = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.root_token_id = **** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.ssl_ca_crt_file = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.timeout = 60.0 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.token_file = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.token_role = None {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.use_ssl = False {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 14:58:36 devstack cinder-volume[85989]: DEBUG oslo_service.backend._eventlet.service [None req-d880b62c-2fc4-4cb2-940e-654a1f472989 None None] ******************************************************************************** {{(pid=85989) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 14:58:36 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:58:36 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:37 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.300s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:37 devstack cinder-volume[86301]: INFO cinder.volume.driver [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.volume.driver [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86301) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_db.sqlalchemy.engines [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writer thread running {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.db.api [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Building query based on filter {{(pid=86301) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86301) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:37 devstack cinder-volume[86301]: INFO cinder.keymgr.migration [None req-e492edb2-3656-4275-b182-140fac746ba2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 14:58:37 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:58:37 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:37 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.285s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:58:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Driver initialization completed successfully. Sep 28 14:58:37 devstack cinder-volume[86301]: INFO cinder.manager [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Initiating service 3 cleanup Sep 28 14:58:37 devstack cinder-volume[86301]: INFO cinder.manager [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Service 3 cleanup completed. Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.service [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Creating RPC server for service cinder-volume {{(pid=86301) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.service [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86301) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 14:58:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:58:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:58:37 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:58:37 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:58:38 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Sep 28 14:58:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.280s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:58:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-806309e8-bbef-46b2-9b2c-d334e6ae87c1 None None] Driver post RPC initialization completed successfully. Sep 28 14:58:46 devstack cinder-volume[85989]: DEBUG dbcounter [-] [85989] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85989) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:58:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 6 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:58:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:58:47 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:58:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:47 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 14:59:47 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:47 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.492s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 6 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 14:59:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Flow 'volume_create_manager' (fd3896a1-f9ff-408a-959e-4d843cbfd231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c7e942-1c32-4fea-8161-924c5dccd00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c7e942-1c32-4fea-8161-924c5dccd00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1303829378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fe64d6-d88e-4773-bb0f-1763fd96b4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9404f451584094bd6ab253c068313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:50Z,use_quota=True,user_id='0d463198323a42808a2d0872ccd75011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7341ab68-39ff-4b4b-8505-211e80cba6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7341ab68-39ff-4b4b-8505-211e80cba6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c1fc0f-d5b8-44b5-a57d-662990209ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c1fc0f-d5b8-44b5-a57d-662990209ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fe64d6-d88e-4773-bb0f-1763fd96b4bf', 'volume_name': 'volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7f69f6-4b49-471a-8b5d-de1d19f61bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7f69f6-4b49-471a-8b5d-de1d19f61bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89249cb4-9dd8-4f42-966a-ecc2aca5c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:50 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Volume f7fe64d6-d88e-4773-bb0f-1763fd96b4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf', 'volume_size': 1} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T12:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1303829378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fe64d6-d88e-4773-bb0f-1763fd96b4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9404f451584094bd6ab253c068313c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T12:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T12:59:50Z,use_quota=True,user_id='0d463198323a42808a2d0872ccd75011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Creating volume f7fe64d6-d88e-4773-bb0f-1763fd96b4bf {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 14:59:50 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 14:59:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:50 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf 1073741824 Sep 28 14:59:50 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:51 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf 1073741824" returned: 0 in 0.747s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 14:59:51 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf Sep 28 14:59:51 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 14:59:51 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf" returned: 0 in 0.360s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89249cb4-9dd8-4f42-966a-ecc2aca5c3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a472dd97-6454-4152-91d7-d131e54a6e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 14:59:51 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Volume volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf (f7fe64d6-d88e-4773-bb0f-1763fd96b4bf): created successfully Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a472dd97-6454-4152-91d7-d131e54a6e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 14:59:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Flow 'volume_create_manager' (fd3896a1-f9ff-408a-959e-4d843cbfd231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 14:59:51 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-29730ae3-cf2b-4add-b3e2-a02d1d2e83c1 tempest-TaggedAttachmentsTest-603918621 None] Created volume successfully. Sep 28 15:00:01 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:01 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:03 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Flow 'volume_create_manager' (db73ca04-cea9-4819-81ac-86525fc8d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047c1050-b3b0-480f-8565-eed92e672b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047c1050-b3b0-480f-8565-eed92e672b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2113199841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8eb94d2-3be0-4176-8b65-1285a65568d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68209c0156354bfa957a07624be24544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:04Z,use_quota=True,user_id='d60213c761574a9e9223604306604c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd379fa-e53c-4185-bd5c-533e2a1ca55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd379fa-e53c-4185-bd5c-533e2a1ca55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325b9e3f-e8bc-41d5-b1da-7c53a501d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325b9e3f-e8bc-41d5-b1da-7c53a501d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8eb94d2-3be0-4176-8b65-1285a65568d4', 'volume_name': 'volume-f8eb94d2-3be0-4176-8b65-1285a65568d4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74d4aea-9d82-4cfa-b3df-c4c442ffd46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74d4aea-9d82-4cfa-b3df-c4c442ffd46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82841e6-60fc-4f16-8d71-c8b4acdcf9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:04 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Volume f8eb94d2-3be0-4176-8b65-1285a65568d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8eb94d2-3be0-4176-8b65-1285a65568d4', 'volume_size': 1} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2113199841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8eb94d2-3be0-4176-8b65-1285a65568d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68209c0156354bfa957a07624be24544',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:04Z,use_quota=True,user_id='d60213c761574a9e9223604306604c63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Creating volume f8eb94d2-3be0-4176-8b65-1285a65568d4 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:04 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:00:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:04 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 1073741824 Sep 28 15:00:04 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:06 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 1073741824" returned: 0 in 2.079s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:06 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 Sep 28 15:00:06 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:07 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4" returned: 0 in 1.232s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] <== create_volume: return (3511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:00:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.520s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82841e6-60fc-4f16-8d71-c8b4acdcf9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8eb94d2-3be0-4176-8b65-1285a65568d4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e6a060-93e6-4aa4-b34f-f142e251e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Volume volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 (f8eb94d2-3be0-4176-8b65-1285a65568d4): created successfully Sep 28 15:00:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67e6a060-93e6-4aa4-b34f-f142e251e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Flow 'volume_create_manager' (db73ca04-cea9-4819-81ac-86525fc8d21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:08 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a033d9a6-08e7-4acb-a10e-cbb95845017b tempest-DeleteServersTestJSON-1663279911 None] Created volume successfully. Sep 28 15:00:17 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:18 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:18 devstack cinder-volume[86301]: WARNING py.warnings [req-1c4cc4c3-3f04-434f-85b8-c140bd32a900 req-fef12342-c949-4a1d-85cb-20038904d452 tempest-DeleteServersTestJSON-1663279911 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 15:00:18 devstack cinder-volume[86301]: .first() Sep 28 15:00:18 devstack cinder-volume[86301]: Sep 28 15:00:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-1c4cc4c3-3f04-434f-85b8-c140bd32a900 req-fef12342-c949-4a1d-85cb-20038904d452 tempest-DeleteServersTestJSON-1663279911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-1c4cc4c3-3f04-434f-85b8-c140bd32a900 req-fef12342-c949-4a1d-85cb-20038904d452 tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-1c4cc4c3-3f04-434f-85b8-c140bd32a900 req-fef12342-c949-4a1d-85cb-20038904d452 tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-1c4cc4c3-3f04-434f-85b8-c140bd32a900 req-fef12342-c949-4a1d-85cb-20038904d452 tempest-DeleteServersTestJSON-1663279911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-f8eb94d2-3be0-4176-8b65-1285a65568d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afde1679-48fe-4357-8b22-2301b9066d85', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:00:18 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-1c4cc4c3-3f04-434f-85b8-c140bd32a900 req-fef12342-c949-4a1d-85cb-20038904d452 tempest-DeleteServersTestJSON-1663279911 None] attachment_update completed successfully. Sep 28 15:00:22 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Flow 'volume_create_manager' (913eaab4-3819-4c4c-ad97-ac0aef919cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375611b0-5cd6-4c21-b7ae-c985cb056d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375611b0-5cd6-4c21-b7ae-c985cb056d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-582348296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ae6b10-4c28-46c2-9d3b-b273b18a3cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdc1756efbe4fce9180ea3d6a7a4d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:23Z,use_quota=True,user_id='465a5c959a7f41cca5804cdb410eb583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcb59b8-c795-4a4f-a747-4ff5f504828c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcb59b8-c795-4a4f-a747-4ff5f504828c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57622c1-90d4-4677-b6b1-0a92dd8d999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a57622c1-90d4-4677-b6b1-0a92dd8d999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ae6b10-4c28-46c2-9d3b-b273b18a3cef', 'volume_name': 'volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34998f8-8874-4cff-9dfa-bae04f5a9108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34998f8-8874-4cff-9dfa-bae04f5a9108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d889e538-8a23-4028-b559-78326a3f1bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Volume a5ae6b10-4c28-46c2-9d3b-b273b18a3cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef', 'volume_size': 1} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-582348296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ae6b10-4c28-46c2-9d3b-b273b18a3cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fdc1756efbe4fce9180ea3d6a7a4d01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:23Z,use_quota=True,user_id='465a5c959a7f41cca5804cdb410eb583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Creating volume a5ae6b10-4c28-46c2-9d3b-b273b18a3cef {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:00:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:23 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef 1073741824 Sep 28 15:00:23 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:25 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef 1073741824" returned: 0 in 1.610s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:25 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef Sep 28 15:00:25 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:25 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef" returned: 0 in 0.488s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d889e538-8a23-4028-b559-78326a3f1bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713d87e-5a54-49f7-8de4-d610eaa527e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:25 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Volume volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef (a5ae6b10-4c28-46c2-9d3b-b273b18a3cef): created successfully Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713d87e-5a54-49f7-8de4-d610eaa527e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Flow 'volume_create_manager' (913eaab4-3819-4c4c-ad97-ac0aef919cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ba87a51e-7bbb-4c8f-b22e-b6985a369087 tempest-ServerRescueNegativeTestJSON-1539881968 None] Created volume successfully. Sep 28 15:00:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-caed3a77-cb59-443a-aad0-d50299951f27 req-a7523663-5941-47c1-919a-4134355ea183 tempest-DeleteServersTestJSON-1663279911 None] Terminate volume connection completed successfully. Sep 28 15:00:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-caed3a77-cb59-443a-aad0-d50299951f27 req-a7523663-5941-47c1-919a-4134355ea183 tempest-DeleteServersTestJSON-1663279911 None] Deleting attachment afde1679-48fe-4357-8b22-2301b9066d85. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:00:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Acquiring lock "cinder-f8eb94d2-3be0-4176-8b65-1285a65568d4-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Lock "cinder-f8eb94d2-3be0-4176-8b65-1285a65568d4-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Acquiring lock "cinder-quobyte-f8eb94d2-3be0-4176-8b65-1285a65568d4" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Lock "cinder-quobyte-f8eb94d2-3be0-4176-8b65-1285a65568d4" acquired by "delete_volume" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:34 devstack cinder-volume[86301]: INFO oslo.privsep.daemon [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy9992fin/privsep.sock'] Sep 28 15:00:34 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy9992fin/privsep.sock Sep 28 15:00:34 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 15:00:35 devstack cinder-volume[86301]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 15:00:36 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:36 devstack cinder-volume[86301]: INFO oslo.privsep.daemon [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Spawned new privsep daemon via rootwrap Sep 28 15:00:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Accepted privsep connection to /tmp/tmpy9992fin/privsep.sock {{(pid=86301) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 15:00:36 devstack cinder-volume[86301]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 15:00:36 devstack cinder-volume[86301]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 15:00:36 devstack cinder-volume[86301]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 15:00:36 devstack cinder-volume[86301]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88234 Sep 28 15:00:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb3be7e-101e-4041-9705-0222789f3cc0]: (2,) {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e146afa-b33a-4fdd-836e-58bcd220e360]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:36 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 Sep 28 15:00:36 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:37 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4" returned: 0 in 1.061s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:37 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4 Sep 28 15:00:37 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:38 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8eb94d2-3be0-4176-8b65-1285a65568d4" returned: 0 in 0.856s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Lock "cinder-quobyte-f8eb94d2-3be0-4176-8b65-1285a65568d4" released by "delete_volume" :: held 4.437s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:38 devstack cinder-volume[86301]: WARNING cinder.quota [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:38 devstack cinder-volume[86301]: WARNING cinder.quota [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:00:38 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Created reservations ['430634ef-b88d-4b24-803b-aa3c6d993187', '6a0d9b5c-0a54-476c-908c-687af6e807a8', '2f252a8d-9922-4caf-805a-f68de9daa7b8', 'd3632b39-dd13-4de2-954b-5be6a16bb3bb'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:39 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:00:39 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:39 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.599s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Deleted volume successfully. Sep 28 15:00:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-297d8264-783d-4b51-a423-457d9249bbad tempest-DeleteServersTestJSON-1663279911 None] Lock "cinder-f8eb94d2-3be0-4176-8b65-1285a65568d4-delete_volume" released by "delete_volume" :: held 5.976s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:47 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:00:47 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:47 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.329s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 8 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:00:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:00:49 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:00:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Acquiring lock "cinder-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "cinder-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Acquiring lock "cinder-quobyte-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:00:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "cinder-quobyte-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:00:49 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b08e4d-ce23-48a8-bfea-5d92554ccdb1]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:00:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:49 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef Sep 28 15:00:49 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:50 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef" returned: 0 in 0.644s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:50 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef Sep 28 15:00:50 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:50 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef" returned: 0 in 0.534s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "cinder-quobyte-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef" released by "delete_volume" :: held 1.274s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:50 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Created reservations ['e586e4b1-6ba7-4029-9a22-4260dfa93637', '7d5f3141-25e6-40f7-bf90-0eec4e8728a6', 'c462bd1f-8b49-4d6f-aeea-1468ec20fd7f', '18e79c10-befb-4b04-8044-d02b158b7495'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:51 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:00:51 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:51 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.540s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:00:51 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Deleted volume successfully. Sep 28 15:00:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8e305891-5e6f-49a6-ac92-afc2e6a77b13 tempest-ServerRescueNegativeTestJSON-1539881968 None] Lock "cinder-a5ae6b10-4c28-46c2-9d3b-b273b18a3cef-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Flow 'volume_create_manager' (9c6bc187-e11e-442e-9ed8-f3bbddc65337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95017a8-25c7-4309-b592-0943d28216b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95017a8-25c7-4309-b592-0943d28216b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1366756674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a24bceaa997486da590d2cb3985bb5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:57Z,use_quota=True,user_id='08a81db8fab74d05bc1a26a96edd5a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d2f50-c514-4090-9d42-3d8742784e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d2f50-c514-4090-9d42-3d8742784e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e0c1af-00f0-438b-8ecc-fcb28ee0a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e0c1af-00f0-438b-8ecc-fcb28ee0a074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a', 'volume_name': 'volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a21de9-6092-4e07-baa0-a00765d0ca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a21de9-6092-4e07-baa0-a00765d0ca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2117bae2-2e75-4f2f-9eed-d128f28472be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Volume ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a', 'volume_size': 1} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1366756674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a24bceaa997486da590d2cb3985bb5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:00:57Z,use_quota=True,user_id='08a81db8fab74d05bc1a26a96edd5a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Creating volume ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:00:57 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:00:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:57 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a 1073741824 Sep 28 15:00:57 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:58 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a 1073741824" returned: 0 in 0.798s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:00:58 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a Sep 28 15:00:58 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:00:58 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a" returned: 0 in 0.438s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2117bae2-2e75-4f2f-9eed-d128f28472be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3cdba5-f351-42c9-aff2-cbb54ac08c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:00:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Volume volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a (ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a): created successfully Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3cdba5-f351-42c9-aff2-cbb54ac08c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:00:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Flow 'volume_create_manager' (9c6bc187-e11e-442e-9ed8-f3bbddc65337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:00:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-91d96585-e225-4855-984d-db59f968511a req-b725eced-6ebb-4905-acfd-8dc3ecd97fd6 tempest-VolumesGetTestJSON-566759940 None] Created volume successfully. Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Acquiring lock "cinder-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Lock "cinder-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Acquiring lock "cinder-quobyte-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Lock "cinder-quobyte-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d128de85-7927-4178-aea3-22772846d046]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:00 devstack sudo[88406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a Sep 28 15:01:00 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:00 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a" returned: 0 in 0.483s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:00 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a Sep 28 15:01:00 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:01 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a" returned: 0 in 0.312s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Lock "cinder-quobyte-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a" released by "delete_volume" :: held 0.894s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG cinder.quota [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Created reservations ['2fc7c2fa-bb86-4723-9315-9b69d3a350db', '685faa8d-c036-4356-9a34-c2d30363c063', '7f58655f-2767-4241-a521-302c089391f1', '966d1141-2e1f-4ab9-bfa7-7c122bf376c5'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:01 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:01:01 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:01 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.507s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:01 devstack cinder-volume[86301]: DEBUG cinder.manager [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:01 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Deleted volume successfully. Sep 28 15:01:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-37c5985e-546b-44cc-88c7-93df0d3dad9c req-8dee37fb-75c8-4091-a864-dc90bce3721f tempest-VolumesGetTestJSON-566759940 None] Lock "cinder-ab3c5bf1-8c4f-4ca9-a57e-78f3aff4af1a-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:11 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=26,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:11 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:01:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-906b2f25-d07c-4b18-a62a-a25ac9986327 tempest-BackendsCapabilitiesAdminTestsJSON-1893672043 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86301) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:01:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-87bb473f-085d-4eec-93b6-b1d497615814 tempest-BackendsCapabilitiesAdminTestsJSON-1893672043 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86301) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:01:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-2a0ae460-f84d-4f2c-8ed9-0096f92c1071 req-dfb9603e-1a7c-4c32-a6d9-75d87808bc50 tempest-TaggedAttachmentsTest-603918621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-2a0ae460-f84d-4f2c-8ed9-0096f92c1071 req-dfb9603e-1a7c-4c32-a6d9-75d87808bc50 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-2a0ae460-f84d-4f2c-8ed9-0096f92c1071 req-dfb9603e-1a7c-4c32-a6d9-75d87808bc50 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-2a0ae460-f84d-4f2c-8ed9-0096f92c1071 req-dfb9603e-1a7c-4c32-a6d9-75d87808bc50 tempest-TaggedAttachmentsTest-603918621 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe94273a-112d-45f1-ae3a-9e26dc387628', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:01:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-2a0ae460-f84d-4f2c-8ed9-0096f92c1071 req-dfb9603e-1a7c-4c32-a6d9-75d87808bc50 tempest-TaggedAttachmentsTest-603918621 None] attachment_update completed successfully. Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Flow 'volume_create_manager' (4e48075e-d6e5-415d-911d-2154ebad4aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd3e65-160e-414f-8a25-b148bdec4956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd3e65-160e-414f-8a25-b148bdec4956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-290188606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b17aad-b7b3-4e6b-a73c-83db10ea4373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f821777cbedd451ab168b8d1a2dd7c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:17Z,use_quota=True,user_id='3150762d64da4e6c8e78e1910940cdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b59e30-b361-4e7c-bba3-1dad03cb3fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b59e30-b361-4e7c-bba3-1dad03cb3fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471f8170-d7b2-41ee-964b-ea8e90e1588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471f8170-d7b2-41ee-964b-ea8e90e1588e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b17aad-b7b3-4e6b-a73c-83db10ea4373', 'volume_name': 'volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f60b52-70b9-4b19-a4eb-807b1be14872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f60b52-70b9-4b19-a4eb-807b1be14872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3d6296-7f09-41f8-b4cc-26407b2c6ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:17 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Volume 82b17aad-b7b3-4e6b-a73c-83db10ea4373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373', 'volume_size': 1} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-290188606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b17aad-b7b3-4e6b-a73c-83db10ea4373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f821777cbedd451ab168b8d1a2dd7c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:17Z,use_quota=True,user_id='3150762d64da4e6c8e78e1910940cdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Creating volume 82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:17 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:01:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:17 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 1073741824 Sep 28 15:01:17 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:18 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 1073741824" returned: 0 in 0.821s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:18 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 Sep 28 15:01:18 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:18 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373" returned: 0 in 0.388s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3d6296-7f09-41f8-b4cc-26407b2c6ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7f940f-3709-4cc9-b57a-bb4c91533c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:18 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Volume volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 (82b17aad-b7b3-4e6b-a73c-83db10ea4373): created successfully Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7f940f-3709-4cc9-b57a-bb4c91533c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Flow 'volume_create_manager' (4e48075e-d6e5-415d-911d-2154ebad4aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:18 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e241edc8-18d2-48ad-ae36-cf907248ead1 req-2aaa7a7f-a520-413c-865f-582be208ac00 tempest-VolumesSnapshotsTestJSON-1484082257 None] Created volume successfully. Sep 28 15:01:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Creating offline snapshot 46a72c6e-2aa0-4216-9b76-5554cfdd1e8c of volume 82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:01:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[676a167d-6803-4abb-811e-2e0f59014efd]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:20 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 Sep 28 15:01:20 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:21 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373" returned: 0 in 0.868s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:21 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c 1G Sep 28 15:01:21 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-52433dc1-e6f0-4b2e-966a-dbf370f7bfc2 req-2ad25b42-4f99-4b87-b8db-40af73177a97 tempest-TaggedAttachmentsTest-603918621 None] Terminate volume connection completed successfully. Sep 28 15:01:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-52433dc1-e6f0-4b2e-966a-dbf370f7bfc2 req-2ad25b42-4f99-4b87-b8db-40af73177a97 tempest-TaggedAttachmentsTest-603918621 None] Deleting attachment fe94273a-112d-45f1-ae3a-9e26dc387628. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:01:22 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c 1G" returned: 0 in 0.962s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:22 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c Sep 28 15:01:22 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:22 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" returned: 0 in 0.631s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:22 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c is being set with open permissions: ugo+rw Sep 28 15:01:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:22 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c Sep 28 15:01:22 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:23 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" returned: 0 in 0.560s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:23 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.info Sep 28 15:01:23 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:24 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.info" returned: 0 in 0.701s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:24 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.info is being set with open permissions: ugo+rw Sep 28 15:01:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:24 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.info Sep 28 15:01:24 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:24 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.info" returned: 0 in 0.534s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.506s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-6ea94370-16ac-4356-9492-d291286a2e43 req-357c6be8-06d3-4e4c-8ceb-2eaa4873c90a tempest-VolumesSnapshotsTestJSON-1484082257 None] Create snapshot completed successfully Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "cinder-46a72c6e-2aa0-4216-9b76-5554cfdd1e8c-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-46a72c6e-2aa0-4216-9b76-5554cfdd1e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "cinder-quobyte-82b17aad-b7b3-4e6b-a73c-83db10ea4373" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-quobyte-82b17aad-b7b3-4e6b-a73c-83db10ea4373" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "cinder-quobyte-46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-quobyte-46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Deleting offline snapshot 46a72c6e-2aa0-4216-9b76-5554cfdd1e8c of volume 82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] snapshot_file for this snap is: volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ef223d-c883-46f5-b166-8f0c67fa6aac]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:25 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c Sep 28 15:01:25 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" returned: 0 in 0.868s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:01:26 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:26 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d388b-7252-49f7-ac81-d05404c6f614]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:26 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 Sep 28 15:01:26 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6120eaba-5b19-4103-ac68-22d9a1efaf66 tempest-GroupSnapshotsTest-1784411527 None] Group tempest-GroupSnapshotsTest-Group-1100395232: creating Sep 28 15:01:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6120eaba-5b19-4103-ac68-22d9a1efaf66 tempest-GroupSnapshotsTest-1784411527 None] Group tempest-GroupSnapshotsTest-Group-1100395232: created successfully Sep 28 15:01:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6120eaba-5b19-4103-ac68-22d9a1efaf66 tempest-GroupSnapshotsTest-1784411527 None] Create group completed successfully. Sep 28 15:01:27 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373" returned: 0 in 0.808s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:27 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c Sep 28 15:01:27 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:27 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" returned: 0 in 0.642s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:27 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c Sep 28 15:01:27 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:28 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373.46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" returned: 0 in 0.413s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-quobyte-46a72c6e-2aa0-4216-9b76-5554cfdd1e8c" released by "_delete_snapshot" :: held 3.026s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-quobyte-82b17aad-b7b3-4e6b-a73c-83db10ea4373" released by "delete_snapshot" :: held 3.099s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:28 devstack cinder-volume[86301]: WARNING cinder.quota [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.quota [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Created reservations ['6eed942b-5ab0-4011-9b8f-d103ee8c152c', '49f84ced-5c97-4fb0-a2ce-d9afcbf9d386', '1371f295-57a5-4bc5-9be6-3a35ec43acff', '9f594704-89dd-40e8-aaa5-d02128786a8c'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Delete snapshot completed successfully. Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-f471d67f-ce1a-4c60-ae06-faa3308ee30a req-d60b879b-e1ea-4815-9559-3d7d8db5ab7e tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-46a72c6e-2aa0-4216-9b76-5554cfdd1e8c-delete_snapshot" released by "delete_snapshot" :: held 3.464s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "cinder-82b17aad-b7b3-4e6b-a73c-83db10ea4373-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-82b17aad-b7b3-4e6b-a73c-83db10ea4373-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "cinder-quobyte-82b17aad-b7b3-4e6b-a73c-83db10ea4373" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-quobyte-82b17aad-b7b3-4e6b-a73c-83db10ea4373" acquired by "delete_volume" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbfe9f4-1cc2-44fa-ac22-b32b5f47a845]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:29 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 Sep 28 15:01:29 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:29 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (2ac136f2-e172-4b8c-bc0a-a81e34f8c076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed905f80-21f2-432b-b49d-7f6949e34335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed905f80-21f2-432b-b49d-7f6949e34335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250790176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=689e103e-6b06-43aa-bc06-1b975e10a62e,host='devstack@QuobyteHD#QuobyteHD',id=a28a6ae3-8757-4cf0-a1dd-10392fe722e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:30Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06534ea2-5065-4ed0-bf13-d35b0e40f4fa),volume_type_id=06534ea2-5065-4ed0-bf13-d35b0e40f4fa)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9312d271-2b24-460d-ace4-9231852a7c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9312d271-2b24-460d-ace4-9231852a7c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbd8a11-5930-43c8-8e76-63b821645e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbd8a11-5930-43c8-8e76-63b821645e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28a6ae3-8757-4cf0-a1dd-10392fe722e5', 'volume_name': 'volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524d650b-1c6a-44b2-a9ad-dd10af629539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524d650b-1c6a-44b2-a9ad-dd10af629539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5c5c87-410d-49aa-9846-2e94025d7383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Volume a28a6ae3-8757-4cf0-a1dd-10392fe722e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5', 'volume_size': 1} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=689e103e-6b06-43aa-bc06-1b975e10a62e,created_at=2026-09-28T13:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-250790176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=689e103e-6b06-43aa-bc06-1b975e10a62e,host='devstack@QuobyteHD#QuobyteHD',id=a28a6ae3-8757-4cf0-a1dd-10392fe722e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:30Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06534ea2-5065-4ed0-bf13-d35b0e40f4fa),volume_type_id=06534ea2-5065-4ed0-bf13-d35b0e40f4fa)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Creating volume a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:30 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:30 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373" returned: 0 in 1.240s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:30 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 1073741824 Sep 28 15:01:30 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:30 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373 Sep 28 15:01:30 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:30 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-82b17aad-b7b3-4e6b-a73c-83db10ea4373" returned: 0 in 0.566s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-quobyte-82b17aad-b7b3-4e6b-a73c-83db10ea4373" released by "delete_volume" :: held 2.000s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG cinder.quota [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Created reservations ['b423fad8-6718-42ac-a983-e75a086af8d6', '9eb643ef-8529-4df2-9085-dceb77705d85', 'e311c942-bcce-46dd-9a2f-d690d4bd0b8a', '0c62afea-35cd-4958-942e-eb71cec9b5b0'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:31 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 1073741824" returned: 0 in 0.926s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:31 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:01:31 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:31 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 Sep 28 15:01:31 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:31 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.536s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG cinder.manager [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Deleted volume successfully. Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-5947bc07-6b3c-4a59-8fbc-9fbad410c34e req-e9333245-5fa8-488b-8bdc-b859ca1d7f8c tempest-VolumesSnapshotsTestJSON-1484082257 None] Lock "cinder-82b17aad-b7b3-4e6b-a73c-83db10ea4373-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:31 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" returned: 0 in 0.493s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5c5c87-410d-49aa-9846-2e94025d7383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ca43fb-45d4-49ca-89e2-b350bcb4f5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Volume volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 (a28a6ae3-8757-4cf0-a1dd-10392fe722e5): created successfully Sep 28 15:01:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ca43fb-45d4-49ca-89e2-b350bcb4f5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (2ac136f2-e172-4b8c-bc0a-a81e34f8c076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:32 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e067ae67-28f4-4ab6-80e7-095b7132606d tempest-GroupSnapshotsTest-1784411527 None] Created volume successfully. Sep 28 15:01:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] GroupSnapshot 1e75c62f-970d-46be-a526-47087127082d: creating. Sep 28 15:01:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Group snapshot 1e75c62f-970d-46be-a526-47087127082d: creating. {{(pid=86301) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:01:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Creating offline snapshot 088316c4-dafa-4eac-9f94-8ef90a6e2f71 of volume a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:01:33 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b46bb0-b525-4411-a1f3-49ca01a2fe97]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:33 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 Sep 28 15:01:33 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:34 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" returned: 0 in 0.868s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:34 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 1G Sep 28 15:01:34 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:35 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 1G" returned: 0 in 0.655s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:35 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 Sep 28 15:01:35 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:35 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71" returned: 0 in 0.482s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:35 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:01:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:35 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 Sep 28 15:01:35 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:35 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71" returned: 0 in 0.427s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:36 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.info Sep 28 15:01:36 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:36 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.info" returned: 0 in 0.344s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:36 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:01:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:36 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.info Sep 28 15:01:36 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:36 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.info" returned: 0 in 0.339s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.267s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-de8f0cb7-33aa-4d8a-9f65-3e616be147f3 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 1e75c62f-970d-46be-a526-47087127082d: created successfully Sep 28 15:01:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-088316c4-dafa-4eac-9f94-8ef90a6e2f71-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:38 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Flow 'volume_create_manager' (18935c40-b8a6-42fe-9bf7-721401678ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fb13e1-3660-40e2-855e-6d71f5a2ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-088316c4-dafa-4eac-9f94-8ef90a6e2f71-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" acquired by "_create_volume_from_snapshot" :: waited 0.101s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Creating volume ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a from snapshot 088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fb13e1-3660-40e2-855e-6d71f5a2ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915616177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e85430-99ef-450e-aaa2-b8eb34e99de0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb9734e71a6a437986a75f2bab586d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:39Z,use_quota=True,user_id='21eee6e023ac4cfaa74f00d4f2ce42b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c9cec1-c58d-4da0-b8d8-0c4eb110f611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c9cec1-c58d-4da0-b8d8-0c4eb110f611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e859820-a1a3-4f4e-b1ab-d3bfde1783dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e859820-a1a3-4f4e-b1ab-d3bfde1783dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e85430-99ef-450e-aaa2-b8eb34e99de0', 'volume_name': 'volume-52e85430-99ef-450e-aaa2-b8eb34e99de0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bace82-e01b-437e-89ff-8d34e6b2c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03bace82-e01b-437e-89ff-8d34e6b2c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da1e7a0-5fcb-42df-8677-03719bc8f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:39 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Volume 52e85430-99ef-450e-aaa2-b8eb34e99de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e85430-99ef-450e-aaa2-b8eb34e99de0', 'volume_size': 1} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" acquired by "_copy_volume_from_snapshot" :: waited 0.121s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] snapshot: 088316c4-dafa-4eac-9f94-8ef90a6e2f71, volume: ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a06561-d201-40ad-bca6-b9782e436691]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:39 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 Sep 28 15:01:39 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:39 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71" returned: 0 in 0.565s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5b256-c019-4c34-ba97-c9a423b126be]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:40 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 Sep 28 15:01:40 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:40 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" returned: 0 in 0.671s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:01:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:01:40 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:01:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:40 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a Sep 28 15:01:40 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Acquiring lock "cinder-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Lock "cinder-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Acquiring lock "cinder-quobyte-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Lock "cinder-quobyte-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c1bb3b-491f-43b7-a632-5d2017d83af7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:41 devstack sudo[89156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf Sep 28 15:01:41 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:42 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf" returned: 0 in 0.804s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:42 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf Sep 28 15:01:42 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:42 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf" returned: 0 in 0.758s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Lock "cinder-quobyte-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf" released by "delete_volume" :: held 1.637s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Created reservations ['f76cdb0f-d1f4-4781-8670-ae9293db241d', '63af35a7-7631-46a2-a846-21f7a2228998', '95811f07-8999-4708-8efc-9ba06af621da', 'edb4dea8-2d1a-47dd-ab63-68f35a1402df'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:43 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:01:43 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:43 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.493s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Deleted volume successfully. Sep 28 15:01:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-577c2ddd-7f0e-492e-af98-5c2d4bb70bd8 tempest-TaggedAttachmentsTest-603918621 None] Lock "cinder-f7fe64d6-d88e-4773-bb0f-1763fd96b4bf-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:47 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:01:47 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:47 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.704s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:51 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" returned: 0 in 10.605s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5, size 1024.00 MB, duration 10.61 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:01:51 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Converted 1024.00 MB image at 96.55 MB/s Sep 28 15:01:51 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:51 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a Sep 28 15:01:51 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:51 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" returned: 0 in 0.297s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" released by "_copy_volume_from_snapshot" :: held 12.292s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-088316c4-dafa-4eac-9f94-8ef90a6e2f71-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" released by "_create_volume_from_snapshot" :: held 12.476s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.578s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.363s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1915616177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e85430-99ef-450e-aaa2-b8eb34e99de0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb9734e71a6a437986a75f2bab586d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:39Z,use_quota=True,user_id='21eee6e023ac4cfaa74f00d4f2ce42b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Creating volume 52e85430-99ef-450e-aaa2-b8eb34e99de0 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:51 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:01:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:51 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 1073741824 Sep 28 15:01:51 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:51 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-252cd576-29b2-4a7a-9b16-af6b61c009b4 tempest-GroupSnapshotsTest-1784411527 None] Create group from source-snapshot-1e75c62f-970d-46be-a526-47087127082d completed successfully. Sep 28 15:01:52 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 1073741824" returned: 0 in 0.703s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:52 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 Sep 28 15:01:52 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:52 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0" returned: 0 in 0.393s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da1e7a0-5fcb-42df-8677-03719bc8f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e85430-99ef-450e-aaa2-b8eb34e99de0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97548ae6-9844-48dd-9626-7887255384a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Volume volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 (52e85430-99ef-450e-aaa2-b8eb34e99de0): created successfully Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97548ae6-9844-48dd-9626-7887255384a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Flow 'volume_create_manager' (18935c40-b8a6-42fe-9bf7-721401678ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7d780f71-269e-4edd-b47d-8e844bb9b758 tempest-VolumesTestJSON-1527553195 None] Created volume successfully. Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" acquired by "delete_volume" :: waited 0.063s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3525c9-2785-4c8b-b0e4-8ac3bbb8447d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:53 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a Sep 28 15:01:53 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:53 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" returned: 0 in 0.526s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:53 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a Sep 28 15:01:53 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:53 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" returned: 0 in 0.454s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-ba8aaf59-9ffc-4ad7-b0c9-eea46a27536a" released by "delete_volume" :: held 1.056s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['03cb8007-6665-4eeb-99d9-bcc86f87c7a0'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:54 devstack cinder-volume[86301]: WARNING cinder.quota [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-462735418 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-462735418, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:01:54 devstack cinder-volume[86301]: WARNING cinder.quota [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-462735418 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-462735418, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['7e51977d-b9f3-4a6d-947f-43e7f7585f7f', '1f4946e4-147f-4d9c-a7be-cb240424af27', '7e9f4d3e-0df4-49c8-aa81-e80ab35208d5', '4e22388e-8deb-412e-ad27-efc0be43ed0c'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:54 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:01:54 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:54 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:54 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:01:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e9741cc2-006b-4765-a630-15516ae120f4 tempest-GroupSnapshotsTest-1784411527 None] Delete group completed successfully. Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Flow 'volume_create_manager' (d51afdce-e494-4628-b9ec-6f74e44e91bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f64c897-fbb3-4d0c-b111-e819759fa97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f64c897-fbb3-4d0c-b111-e819759fa97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057485873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c92c4cf-b79e-40b0-852f-b39ee720055f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb9734e71a6a437986a75f2bab586d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:55Z,use_quota=True,user_id='21eee6e023ac4cfaa74f00d4f2ce42b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faadd518-696d-4d20-91a3-20ec1c673487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faadd518-696d-4d20-91a3-20ec1c673487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576673c6-33cd-4bb8-afea-31dffbb035c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576673c6-33cd-4bb8-afea-31dffbb035c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c92c4cf-b79e-40b0-852f-b39ee720055f', 'volume_name': 'volume-1c92c4cf-b79e-40b0-852f-b39ee720055f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe41b08-11b9-4e89-9fce-96e039b9e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe41b08-11b9-4e89-9fce-96e039b9e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f4abbc-d59a-45bf-9aed-da286a5fd52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:55 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Volume 1c92c4cf-b79e-40b0-852f-b39ee720055f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c92c4cf-b79e-40b0-852f-b39ee720055f', 'volume_size': 1} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057485873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c92c4cf-b79e-40b0-852f-b39ee720055f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb9734e71a6a437986a75f2bab586d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:55Z,use_quota=True,user_id='21eee6e023ac4cfaa74f00d4f2ce42b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Creating volume 1c92c4cf-b79e-40b0-852f-b39ee720055f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:55 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:55 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f 1073741824 Sep 28 15:01:55 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 1e75c62f-970d-46be-a526-47087127082d: deleting Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 1e75c62f-970d-46be-a526-47087127082d: deleting {{(pid=86301) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-088316c4-dafa-4eac-9f94-8ef90a6e2f71" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-088316c4-dafa-4eac-9f94-8ef90a6e2f71" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Deleting offline snapshot 088316c4-dafa-4eac-9f94-8ef90a6e2f71 of volume a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] snapshot_file for this snap is: volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab7af6b-0902-49cc-a188-30df9aed37b4]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:56 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 Sep 28 15:01:56 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:56 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f 1073741824" returned: 0 in 0.908s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:56 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f Sep 28 15:01:56 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:56 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71" returned: 0 in 0.664s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882a003-7e28-47f8-b11e-3853bef8a918]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:56 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f" returned: 0 in 0.458s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f4abbc-d59a-45bf-9aed-da286a5fd52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c92c4cf-b79e-40b0-852f-b39ee720055f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827c5d75-d855-4c60-9fe4-25b84ec62e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:56 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Volume volume-1c92c4cf-b79e-40b0-852f-b39ee720055f (1c92c4cf-b79e-40b0-852f-b39ee720055f): created successfully Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827c5d75-d855-4c60-9fe4-25b84ec62e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Flow 'volume_create_manager' (d51afdce-e494-4628-b9ec-6f74e44e91bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fd3d9dfc-399a-4cf1-b138-1e1e5613ccc7 tempest-VolumesTestJSON-1527553195 None] Created volume successfully. Sep 28 15:01:56 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 Sep 28 15:01:56 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:57 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" returned: 0 in 0.994s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:57 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 Sep 28 15:01:57 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Flow 'volume_create_manager' (3a2e42d7-5848-4c7f-92bf-74bb3d69ea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9e52a2-3232-4e62-8a01-e8de4aeb7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:58 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71" returned: 0 in 0.757s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9e52a2-3232-4e62-8a01-e8de4aeb7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2111331102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512544b2-7860-4cda-a473-1f45ae6975de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb9734e71a6a437986a75f2bab586d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:58Z,use_quota=True,user_id='21eee6e023ac4cfaa74f00d4f2ce42b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:58 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71 Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcca7dc-d588-44f4-9699-f4022570dce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bcca7dc-d588-44f4-9699-f4022570dce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:58 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec865a1-3a1b-48ac-8df9-d49adfff7def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec865a1-3a1b-48ac-8df9-d49adfff7def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512544b2-7860-4cda-a473-1f45ae6975de', 'volume_name': 'volume-512544b2-7860-4cda-a473-1f45ae6975de', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e825881f-cff9-43e2-a8b0-602196bfa0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e825881f-cff9-43e2-a8b0-602196bfa0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f841d88-0d7d-4b89-b445-a789d1e0f543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:01:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Volume 512544b2-7860-4cda-a473-1f45ae6975de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512544b2-7860-4cda-a473-1f45ae6975de', 'volume_size': 1} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2111331102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512544b2-7860-4cda-a473-1f45ae6975de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb9734e71a6a437986a75f2bab586d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:01:58Z,use_quota=True,user_id='21eee6e023ac4cfaa74f00d4f2ce42b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Creating volume 512544b2-7860-4cda-a473-1f45ae6975de {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:01:58 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:58 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de 1073741824 Sep 28 15:01:58 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:01:58 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5.088316c4-dafa-4eac-9f94-8ef90a6e2f71" returned: 0 in 0.655s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-088316c4-dafa-4eac-9f94-8ef90a6e2f71" released by "_delete_snapshot" :: held 3.358s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" released by "delete_snapshot" :: held 3.411s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:01:59 devstack cinder-volume[86301]: WARNING cinder.quota [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-462735418 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-462735418, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:01:59 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['7a6eafc1-6e30-425e-8b16-d9f8057fa2e3', '11d3e37d-0e44-4ea4-bbcf-dfafe4a45ce5', 'f3628412-d717-4de7-8871-df9fbd1de7b1', '588e6263-f0ce-4fec-bc8e-61e4d3dbfbb1'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:01:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8615ea71-c85c-4c59-a707-1e7d425ca973 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 1e75c62f-970d-46be-a526-47087127082d: deleted successfully Sep 28 15:01:59 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Sep 28 15:01:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de 1073741824" returned: 0 in 1.265s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:01:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:01:59 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de Sep 28 15:01:59 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:00 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de" returned: 0 in 0.494s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f841d88-0d7d-4b89-b445-a789d1e0f543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512544b2-7860-4cda-a473-1f45ae6975de', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ecb8c2-abf8-4cce-a5fe-4c9d829a2de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Volume volume-512544b2-7860-4cda-a473-1f45ae6975de (512544b2-7860-4cda-a473-1f45ae6975de): created successfully Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ecb8c2-abf8-4cce-a5fe-4c9d829a2de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Flow 'volume_create_manager' (3a2e42d7-5848-4c7f-92bf-74bb3d69ea81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2ce30f82-0286-45aa-9f15-b98e05833645 tempest-VolumesTestJSON-1527553195 None] Created volume successfully. Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[271f1870-e670-4788-87be-ccd0a7d9f4fe]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:01 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 Sep 28 15:02:01 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:01 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" returned: 0 in 0.952s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:01 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5 Sep 28 15:02:01 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:02 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-a28a6ae3-8757-4cf0-a1dd-10392fe722e5" released by "delete_volume" :: held 1.497s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['eb073c7d-2679-45cb-99e9-4285708b27ff'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:02 devstack cinder-volume[86301]: WARNING cinder.db.api [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-462735418'] Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['784a91e6-1472-47e9-9c01-92ae4c8412cf', '8825a869-0d4b-4bd4-96d7-043261d6e893', '943c6f4a-6358-4b46-a069-5a9003b1180b', '7ca0b0ab-45fe-44ef-bafd-a883dd65fa23'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:02 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:02 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Acquiring lock "cinder-512544b2-7860-4cda-a473-1f45ae6975de-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:03 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.459s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f3292ef5-1fce-4638-99a4-584452a9030f tempest-GroupSnapshotsTest-1784411527 None] Delete group completed successfully. Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Lock "cinder-512544b2-7860-4cda-a473-1f45ae6975de-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Acquiring lock "cinder-quobyte-512544b2-7860-4cda-a473-1f45ae6975de" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Lock "cinder-quobyte-512544b2-7860-4cda-a473-1f45ae6975de" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ee2b38-6993-4dad-b21d-3d0ab006fa9f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:03 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de Sep 28 15:02:03 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:04 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de" returned: 0 in 0.809s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:04 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de Sep 28 15:02:04 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:05 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-512544b2-7860-4cda-a473-1f45ae6975de" returned: 0 in 0.537s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Lock "cinder-quobyte-512544b2-7860-4cda-a473-1f45ae6975de" released by "delete_volume" :: held 1.521s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Created reservations ['8adbf4ef-c05b-4f61-8acb-31ce7b747b8e', 'eaae1b21-0ba3-4161-89e5-910b11547779', 'a3c100d2-2907-4c7c-b7ab-df9fa9d56863', 'f1392fcf-9f64-4dae-8c2a-556f1117c3e0'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Flow 'volume_create_manager' (2a6872b1-461f-4e86-ae74-d780627d735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde5128b-9aa7-49a8-893a-e25c77dee98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6fa2fb5b-27df-40e3-a5bd-f6ae6a219c91 tempest-GroupSnapshotsTest-1784411527 None] Group tempest-GroupSnapshotsTest-Group-1469059547: creating Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde5128b-9aa7-49a8-893a-e25c77dee98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-277363414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162cf967-9d57-431b-a48c-f93580d3fbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5396c20bb8f4fc69bc0e650c21f4106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:05Z,use_quota=True,user_id='7790f18d2013422284087b10ae0d0b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbfab84-fe1a-40ec-a22c-79088f0d955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbfab84-fe1a-40ec-a22c-79088f0d955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d016009-787e-4843-8eb7-a18b3707808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d016009-787e-4843-8eb7-a18b3707808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162cf967-9d57-431b-a48c-f93580d3fbd5', 'volume_name': 'volume-162cf967-9d57-431b-a48c-f93580d3fbd5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550b6e64-9a87-48dd-b3e0-520aeeac49c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (550b6e64-9a87-48dd-b3e0-520aeeac49c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc01cae6-a2b6-4cbd-96cf-470e56ef2179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:05 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Volume 162cf967-9d57-431b-a48c-f93580d3fbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162cf967-9d57-431b-a48c-f93580d3fbd5', 'volume_size': 1} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-277363414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162cf967-9d57-431b-a48c-f93580d3fbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5396c20bb8f4fc69bc0e650c21f4106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:05Z,use_quota=True,user_id='7790f18d2013422284087b10ae0d0b12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Creating volume 162cf967-9d57-431b-a48c-f93580d3fbd5 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:05 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:05 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 1073741824 Sep 28 15:02:05 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6fa2fb5b-27df-40e3-a5bd-f6ae6a219c91 tempest-GroupSnapshotsTest-1784411527 None] Group tempest-GroupSnapshotsTest-Group-1469059547: created successfully Sep 28 15:02:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6fa2fb5b-27df-40e3-a5bd-f6ae6a219c91 tempest-GroupSnapshotsTest-1784411527 None] Create group completed successfully. Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:05 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:05 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Acquiring lock "cinder-1c92c4cf-b79e-40b0-852f-b39ee720055f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-1c92c4cf-b79e-40b0-852f-b39ee720055f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:06 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.542s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Acquiring lock "cinder-quobyte-1c92c4cf-b79e-40b0-852f-b39ee720055f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Deleted volume successfully. Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-quobyte-1c92c4cf-b79e-40b0-852f-b39ee720055f" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb23d35c-3153-4062-8241-d82576585d1a tempest-VolumesTestJSON-1527553195 None] Lock "cinder-512544b2-7860-4cda-a473-1f45ae6975de-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5598c24-5b99-47b6-83a4-2cd8a3bcb0fb]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:06 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f Sep 28 15:02:06 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:06 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 1073741824" returned: 0 in 0.999s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:06 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 Sep 28 15:02:06 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:07 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f" returned: 0 in 0.724s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:07 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f Sep 28 15:02:07 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:07 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5" returned: 0 in 0.593s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc01cae6-a2b6-4cbd-96cf-470e56ef2179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162cf967-9d57-431b-a48c-f93580d3fbd5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac47b5f-548f-4a43-bd58-410f003f2cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Volume volume-162cf967-9d57-431b-a48c-f93580d3fbd5 (162cf967-9d57-431b-a48c-f93580d3fbd5): created successfully Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac47b5f-548f-4a43-bd58-410f003f2cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Flow 'volume_create_manager' (2a6872b1-461f-4e86-ae74-d780627d735d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:07 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-07cd8476-0e22-41da-95f2-5851f2d1ec97 tempest-VolumesAdminNegativeTest-1031414374 None] Created volume successfully. Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (d0ddf8a3-a68d-4ebf-9343-0afbb9a438b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4831864e-e9fc-4cf6-961c-186edf217287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4831864e-e9fc-4cf6-961c-186edf217287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-864604136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e7558f8-4dac-4c3c-9ab1-1be1f3a0ef59,host='devstack@QuobyteHD#QuobyteHD',id=d755d8f6-3a1b-4726-a071-e56cdae3dceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:07Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dea0acf1-5631-460c-8815-c9f9c252dbe6),volume_type_id=dea0acf1-5631-460c-8815-c9f9c252dbe6)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01a077f-852e-454d-b45a-906abd9c5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01a077f-852e-454d-b45a-906abd9c5245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d85de7-968c-4dc5-8e8b-14ec05f5feac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d85de7-968c-4dc5-8e8b-14ec05f5feac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd755d8f6-3a1b-4726-a071-e56cdae3dceb', 'volume_name': 'volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0fc0b1-991e-47a6-9ed8-3ea5bdf7aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0fc0b1-991e-47a6-9ed8-3ea5bdf7aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96694d1d-5fb6-4bb8-a86b-759b871771a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:07 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Volume d755d8f6-3a1b-4726-a071-e56cdae3dceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb', 'volume_size': 1} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e7558f8-4dac-4c3c-9ab1-1be1f3a0ef59,created_at=2026-09-28T13:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-864604136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e7558f8-4dac-4c3c-9ab1-1be1f3a0ef59,host='devstack@QuobyteHD#QuobyteHD',id=d755d8f6-3a1b-4726-a071-e56cdae3dceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:07Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dea0acf1-5631-460c-8815-c9f9c252dbe6),volume_type_id=dea0acf1-5631-460c-8815-c9f9c252dbe6)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Creating volume d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:07 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c92c4cf-b79e-40b0-852f-b39ee720055f" returned: 0 in 0.776s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:07 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb 1073741824 Sep 28 15:02:07 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-quobyte-1c92c4cf-b79e-40b0-852f-b39ee720055f" released by "delete_volume" :: held 1.587s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:07 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Created reservations ['37924b02-c926-4af8-bd8c-633c89d95240', 'e207ddce-cac5-4c83-8cf4-1333bbbfbb76', 'ebdeaa1b-868f-46cc-8bf9-612a5c33d285', '52190462-f49b-4661-9c50-a3e2869a0491'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:08 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:08 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb 1073741824" returned: 0 in 0.728s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:08 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Acquiring lock "cinder-52e85430-99ef-450e-aaa2-b8eb34e99de0-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.589s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:08 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb Sep 28 15:02:08 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-52e85430-99ef-450e-aaa2-b8eb34e99de0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:08 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Deleted volume successfully. Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cfe2954-2d5b-43ac-bfd2-ce115eefd99d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-1c92c4cf-b79e-40b0-852f-b39ee720055f-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Acquiring lock "cinder-quobyte-52e85430-99ef-450e-aaa2-b8eb34e99de0" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-quobyte-52e85430-99ef-450e-aaa2-b8eb34e99de0" acquired by "delete_volume" :: waited 0.036s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8658c55-c772-4012-8d92-87d1ab838c85]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:09 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 Sep 28 15:02:09 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:09 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb" returned: 0 in 0.885s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96694d1d-5fb6-4bb8-a86b-759b871771a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5755d3da-04ee-4186-b228-6a929b7bdf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:09 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Volume volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb (d755d8f6-3a1b-4726-a071-e56cdae3dceb): created successfully Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5755d3da-04ee-4186-b228-6a929b7bdf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (d0ddf8a3-a68d-4ebf-9343-0afbb9a438b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-026b146b-ed7f-4501-b723-3db3aee96b8a tempest-GroupSnapshotsTest-1784411527 None] Created volume successfully. Sep 28 15:02:09 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0" returned: 0 in 0.743s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:09 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0 Sep 28 15:02:09 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Acquiring lock "cinder-162cf967-9d57-431b-a48c-f93580d3fbd5-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "cinder-162cf967-9d57-431b-a48c-f93580d3fbd5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Acquiring lock "cinder-quobyte-162cf967-9d57-431b-a48c-f93580d3fbd5" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "cinder-quobyte-162cf967-9d57-431b-a48c-f93580d3fbd5" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0f6db-1582-4c8d-8a05-d852888e63a5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-52e85430-99ef-450e-aaa2-b8eb34e99de0" returned: 0 in 0.421s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-quobyte-52e85430-99ef-450e-aaa2-b8eb34e99de0" released by "delete_volume" :: held 1.284s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:10 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 Sep 28 15:02:10 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Created reservations ['99e1a4eb-5b92-4122-a264-e574cc717f17', 'c4a96736-a3cd-47db-b671-c3ead321156c', '904f4c30-935f-4dae-ba21-bd7cd3d44735', '6c9281a3-4df5-4485-a8ad-0b68643d136a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:10 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5" returned: 0 in 0.661s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:10 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5 Sep 28 15:02:10 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:10 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.402s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Deleted volume successfully. Sep 28 15:02:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f94a6f6b-2d1e-4c05-8dfb-be9564ac5f3d tempest-VolumesTestJSON-1527553195 None] Lock "cinder-52e85430-99ef-450e-aaa2-b8eb34e99de0-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:11 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-162cf967-9d57-431b-a48c-f93580d3fbd5" returned: 0 in 0.546s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "cinder-quobyte-162cf967-9d57-431b-a48c-f93580d3fbd5" released by "delete_volume" :: held 1.318s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=90,cinder:UPDATE=94,cinder:INSERT=30,cinder:DELETE=5 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Created reservations ['16d0d19a-4a8e-4206-8225-a3f28ef567a5', '785a3a02-de35-4110-89ed-a04f082cbcd0', 'f0fe626b-fe82-4a12-a181-6ddc3d879548', 'de6db9fa-fa5d-4cc6-92b3-09b09acdc356'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:11 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:11 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=105,cinder:UPDATE=121,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (26f460ab-3bcc-4c27-b0f1-34ffbcd999df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8001d9-52c7-4412-b724-0c255e98b8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8001d9-52c7-4412-b724-0c255e98b8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-905716261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e7558f8-4dac-4c3c-9ab1-1be1f3a0ef59,host='devstack@QuobyteHD#QuobyteHD',id=9d2b0c70-bd0f-4680-b541-fcfcff7f17fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:12Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dea0acf1-5631-460c-8815-c9f9c252dbe6),volume_type_id=dea0acf1-5631-460c-8815-c9f9c252dbe6)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676f0042-bdfe-4c6f-a01d-a1a9f77de802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676f0042-bdfe-4c6f-a01d-a1a9f77de802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a0a3f1-2dc8-48b8-b43c-b29130504018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:12 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a0a3f1-2dc8-48b8-b43c-b29130504018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2b0c70-bd0f-4680-b541-fcfcff7f17fc', 'volume_name': 'volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cf4279-a657-44b9-8477-0fff13202a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cf4279-a657-44b9-8477-0fff13202a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32639be-d86e-4341-95cf-324ac7314043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:12 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Volume 9d2b0c70-bd0f-4680-b541-fcfcff7f17fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc', 'volume_size': 1} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e7558f8-4dac-4c3c-9ab1-1be1f3a0ef59,created_at=2026-09-28T13:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-905716261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e7558f8-4dac-4c3c-9ab1-1be1f3a0ef59,host='devstack@QuobyteHD#QuobyteHD',id=9d2b0c70-bd0f-4680-b541-fcfcff7f17fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:12Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dea0acf1-5631-460c-8815-c9f9c252dbe6),volume_type_id=dea0acf1-5631-460c-8815-c9f9c252dbe6)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Creating volume 9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:12 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.792s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:12 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc 1073741824 Sep 28 15:02:12 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:12 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Deleted volume successfully. Sep 28 15:02:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba005c53-afe8-48b3-92a3-551c362fc403 tempest-VolumesAdminNegativeTest-1031414374 None] Lock "cinder-162cf967-9d57-431b-a48c-f93580d3fbd5-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:13 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc 1073741824" returned: 0 in 1.114s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:13 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc Sep 28 15:02:13 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:14 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" returned: 0 in 0.463s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32639be-d86e-4341-95cf-324ac7314043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cb350a-a628-4085-ac16-3fbce0d3554b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:14 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Volume volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc (9d2b0c70-bd0f-4680-b541-fcfcff7f17fc): created successfully Sep 28 15:02:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65cb350a-a628-4085-ac16-3fbce0d3554b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (26f460ab-3bcc-4c27-b0f1-34ffbcd999df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-923b132a-95cb-4ba4-8746-fab3eb3b3280 tempest-GroupSnapshotsTest-1784411527 None] Created volume successfully. Sep 28 15:02:15 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-835692b9-ca35-4fa9-90f0-cdf592f0843d tempest-GroupSnapshotsTest-1784411527 None] Update group completed successfully. Sep 28 15:02:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9596e978-d2ec-4878-a298-ee2cc4c5e408 tempest-GroupSnapshotsTest-1784411527 None] Update group completed successfully. Sep 28 15:02:17 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-35a3d515-5d06-4e8a-8e92-813acda11360 tempest-GroupSnapshotsTest-1784411527 None] Update group completed successfully. Sep 28 15:02:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-39029028-b933-400b-9f1d-a3fba1207e8a tempest-GroupSnapshotsTest-1784411527 None] Update group completed successfully. Sep 28 15:02:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-64c96492-3f0d-4e54-8bbf-5baec056778d tempest-GroupsV314Test-576654958 None] Group tempest-GroupsV314Test-Group-2037979069: creating Sep 28 15:02:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-64c96492-3f0d-4e54-8bbf-5baec056778d tempest-GroupsV314Test-576654958 None] Group tempest-GroupsV314Test-Group-2037979069: created successfully Sep 28 15:02:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-64c96492-3f0d-4e54-8bbf-5baec056778d tempest-GroupsV314Test-576654958 None] Create group completed successfully. Sep 28 15:02:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] GroupSnapshot 417673d1-04b2-4ab8-8ba5-33da8e83e47e: creating. Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Group snapshot 417673d1-04b2-4ab8-8ba5-33da8e83e47e: creating. {{(pid=86301) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Creating offline snapshot 134c6520-86a2-49af-89d2-15caf633207b of volume d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7a5bb8-9a4b-42de-8589-5c0d47f73a82]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:21 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb Sep 28 15:02:21 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:21 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb" returned: 0 in 0.552s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:21 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b 1G Sep 28 15:02:21 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:22 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b 1G" returned: 0 in 0.771s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:22 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b Sep 28 15:02:22 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-42c12c48-1ea8-457e-bd22-e551c552a2b9 tempest-GroupSnapshotsV319Test-1937029371 None] Group tempest-GroupSnapshotsV319Test-Group-1791486169: creating Sep 28 15:02:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-42c12c48-1ea8-457e-bd22-e551c552a2b9 tempest-GroupSnapshotsV319Test-1937029371 None] Group tempest-GroupSnapshotsV319Test-Group-1791486169: created successfully Sep 28 15:02:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-42c12c48-1ea8-457e-bd22-e551c552a2b9 tempest-GroupSnapshotsV319Test-1937029371 None] Create group completed successfully. Sep 28 15:02:22 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Flow 'volume_create_manager' (7cc253f6-ddc4-4cb3-abb0-cc7435b652af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f6d460-05a5-4cd3-a799-0cc473462fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f6d460-05a5-4cd3-a799-0cc473462fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173036006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a66e8cee-5ada-442a-a032-b37fe81e6a93,host='devstack@QuobyteHD#QuobyteHD',id=d588a104-eb70-4ce0-9988-8ec6ec119f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282fce6ba3be4622b1dac599b3bccc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:23Z,use_quota=True,user_id='2e49a3c7dec04b70b0279b87f3e60024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dadcaf-5cbf-4438-81de-3478c8e2e107),volume_type_id=f5dadcaf-5cbf-4438-81de-3478c8e2e107)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58515a3c-acb4-4082-9e42-7585ca14c085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:23 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58515a3c-acb4-4082-9e42-7585ca14c085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b8499c-08e1-4ef1-9a6f-e9f42899eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b8499c-08e1-4ef1-9a6f-e9f42899eee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd588a104-eb70-4ce0-9988-8ec6ec119f81', 'volume_name': 'volume-d588a104-eb70-4ce0-9988-8ec6ec119f81', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48903ed-fe8c-486c-a0b4-d24246bad034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48903ed-fe8c-486c-a0b4-d24246bad034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89398480-7528-4f16-af60-472a9ce3ada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Volume d588a104-eb70-4ce0-9988-8ec6ec119f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d588a104-eb70-4ce0-9988-8ec6ec119f81', 'volume_size': 1} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b" returned: 0 in 0.545s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:23 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:23 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b Sep 28 15:02:23 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:23 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b" returned: 0 in 0.347s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:23 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.info Sep 28 15:02:23 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:23 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.info" returned: 0 in 0.342s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:23 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:23 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.info Sep 28 15:02:23 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:24 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.info" returned: 0 in 0.337s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Creating offline snapshot 9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 of volume 9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1bbb6d-b83c-48bb-861f-a19ab5f53a11]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:24 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc Sep 28 15:02:24 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Flow 'volume_create_manager' (40825075-0f7e-405e-9e25-b135091e45e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bbc6de-d716-407b-8e7d-11123348bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bbc6de-d716-407b-8e7d-11123348bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-330797644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f18807b7-7ac7-4fda-a2df-453119dc639a,host='devstack@QuobyteHD#QuobyteHD',id=e89ea5df-a74a-45cd-b35b-642596e78cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3f5bef88b864dd689959070846c43bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:24Z,use_quota=True,user_id='7dfa204664924f4889eb76bb018f1dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d31808-4d3f-4e93-803c-88e713e3db18),volume_type_id=32d31808-4d3f-4e93-803c-88e713e3db18)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1924d1-f043-4c62-a1f1-39c807af4e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1924d1-f043-4c62-a1f1-39c807af4e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9a7dc5-13c0-413f-b907-f24013f1fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9a7dc5-13c0-413f-b907-f24013f1fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89ea5df-a74a-45cd-b35b-642596e78cac', 'volume_name': 'volume-e89ea5df-a74a-45cd-b35b-642596e78cac', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd4506a-7f41-48e5-adfe-c0ce6d7a4ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd4506a-7f41-48e5-adfe-c0ce6d7a4ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81ddb7a-bda8-49a1-b3de-4b3c6b5b90cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Volume e89ea5df-a74a-45cd-b35b-642596e78cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89ea5df-a74a-45cd-b35b-642596e78cac', 'volume_size': 1} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:24 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" returned: 0 in 0.557s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:24 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 1G Sep 28 15:02:24 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:25 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 1G" returned: 0 in 0.457s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:25 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 Sep 28 15:02:25 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:25 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" returned: 0 in 0.389s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:25 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:25 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 Sep 28 15:02:25 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:25 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" returned: 0 in 0.283s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:25 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.info Sep 28 15:02:25 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:26 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.info" returned: 0 in 0.311s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:26 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:26 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.info Sep 28 15:02:26 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:26 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.info" returned: 0 in 0.374s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.623s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a66e8cee-5ada-442a-a032-b37fe81e6a93,created_at=2026-09-28T13:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173036006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a66e8cee-5ada-442a-a032-b37fe81e6a93,host='devstack@QuobyteHD#QuobyteHD',id=d588a104-eb70-4ce0-9988-8ec6ec119f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282fce6ba3be4622b1dac599b3bccc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:23Z,use_quota=True,user_id='2e49a3c7dec04b70b0279b87f3e60024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5dadcaf-5cbf-4438-81de-3478c8e2e107),volume_type_id=f5dadcaf-5cbf-4438-81de-3478c8e2e107)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Creating volume d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:26 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:02:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:26 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 1073741824 Sep 28 15:02:26 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cc9b4377-0881-470a-9fff-755c2a16cd55 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 417673d1-04b2-4ab8-8ba5-33da8e83e47e: created successfully Sep 28 15:02:27 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 1073741824" returned: 0 in 0.477s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:27 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 Sep 28 15:02:27 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:27 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81" returned: 0 in 0.247s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.803s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f18807b7-7ac7-4fda-a2df-453119dc639a,created_at=2026-09-28T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-330797644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f18807b7-7ac7-4fda-a2df-453119dc639a,host='devstack@QuobyteHD#QuobyteHD',id=e89ea5df-a74a-45cd-b35b-642596e78cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3f5bef88b864dd689959070846c43bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:24Z,use_quota=True,user_id='7dfa204664924f4889eb76bb018f1dea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d31808-4d3f-4e93-803c-88e713e3db18),volume_type_id=32d31808-4d3f-4e93-803c-88e713e3db18)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Creating volume e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:27 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89398480-7528-4f16-af60-472a9ce3ada1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d588a104-eb70-4ce0-9988-8ec6ec119f81', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0b8661-bd21-4537-965c-ae2017fb0a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:27 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac 1073741824 Sep 28 15:02:27 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:27 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Volume volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 (d588a104-eb70-4ce0-9988-8ec6ec119f81): created successfully Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0b8661-bd21-4537-965c-ae2017fb0a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Flow 'volume_create_manager' (7cc253f6-ddc4-4cb3-abb0-cc7435b652af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b426d020-4b38-4e8b-87dd-b5813787d52c tempest-GroupsV314Test-576654958 None] Created volume successfully. Sep 28 15:02:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 417673d1-04b2-4ab8-8ba5-33da8e83e47e: deleting Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 417673d1-04b2-4ab8-8ba5-33da8e83e47e: deleting {{(pid=86301) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-d755d8f6-3a1b-4726-a071-e56cdae3dceb" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-d755d8f6-3a1b-4726-a071-e56cdae3dceb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-134c6520-86a2-49af-89d2-15caf633207b" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-134c6520-86a2-49af-89d2-15caf633207b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Deleting offline snapshot 134c6520-86a2-49af-89d2-15caf633207b of volume d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:02:28 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] snapshot_file for this snap is: volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac 1073741824" returned: 0 in 0.828s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d934d99d-9885-4f0d-849d-8b12455b4949]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:28 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac Sep 28 15:02:28 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:28 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b Sep 28 15:02:28 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:28 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac" returned: 0 in 0.518s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.024s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:28 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Cloning volume d588a104-eb70-4ce0-9988-8ec6ec119f81 to volume 8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81ddb7a-bda8-49a1-b3de-4b3c6b5b90cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89ea5df-a74a-45cd-b35b-642596e78cac', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:28 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f87187-fe44-4f58-84e9-269ac6a51ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b" returned: 0 in 0.641s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Volume volume-e89ea5df-a74a-45cd-b35b-642596e78cac (e89ea5df-a74a-45cd-b35b-642596e78cac): created successfully Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f87187-fe44-4f58-84e9-269ac6a51ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Flow 'volume_create_manager' (40825075-0f7e-405e-9e25-b135091e45e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e77f7-1b0f-4ad4-a944-380cfd539267]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Creating offline snapshot ce91b052-2d80-4521-9fd2-ff35c9b05111 of volume d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:02:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9127c904-373f-4400-8a58-ce5c7b437161 tempest-GroupSnapshotsV319Test-1937029371 None] Created volume successfully. Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5c8137-13da-471b-8051-52e828c876df]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:29 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb Sep 28 15:02:29 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:29 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 Sep 28 15:02:29 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:29 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb" returned: 0 in 0.595s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:29 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b Sep 28 15:02:29 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:29 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81" returned: 0 in 0.586s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:29 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 1G Sep 28 15:02:29 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] GroupSnapshot f92acbbe-3093-402f-8f68-e14e4bb85ef9: creating. Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Group snapshot f92acbbe-3093-402f-8f68-e14e4bb85ef9: creating. {{(pid=86301) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:30 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b" returned: 0 in 0.484s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:30 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b Sep 28 15:02:30 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:30 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 1G" returned: 0 in 0.554s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:30 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 Sep 28 15:02:30 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:30 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb.134c6520-86a2-49af-89d2-15caf633207b" returned: 0 in 0.328s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-134c6520-86a2-49af-89d2-15caf633207b" released by "_delete_snapshot" :: held 2.282s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-d755d8f6-3a1b-4726-a071-e56cdae3dceb" released by "delete_snapshot" :: held 2.321s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Deleting offline snapshot 9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 of volume 9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] snapshot_file for this snap is: volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[140151bb-6bd1-4eeb-bc24-33fc09bc8bd1]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:30 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111" returned: 0 in 0.450s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:30 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:30 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 Sep 28 15:02:30 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:30 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 Sep 28 15:02:30 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111" returned: 0 in 0.307s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.info Sep 28 15:02:31 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" returned: 0 in 0.496s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d868312a-7f85-412f-8492-09d3ec80d9e0]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc Sep 28 15:02:31 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.info" returned: 0 in 0.332s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.info Sep 28 15:02:31 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.info" returned: 0 in 0.366s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Acquiring lock "cinder-quobyte-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" returned: 0 in 0.595s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] snapshot: ce91b052-2d80-4521-9fd2-ff35c9b05111, volume: 8eb49bd0-d8b0-4cce-a401-7856a85c1bb7, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:02:31 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 Sep 28 15:02:31 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5057ae0-4022-42da-bb71-69eb1b1b2508]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:32 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 Sep 28 15:02:32 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:32 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" returned: 0 in 0.489s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:32 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5 Sep 28 15:02:32 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:32 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111" returned: 0 in 0.511s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d588a104-eb70-4ce0-9988-8ec6ec119f81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede83775-170f-44d6-b2e9-a41e6b694079]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:32 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 Sep 28 15:02:32 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:32 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc.9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" returned: 0 in 0.333s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-9ee1f56c-b2e0-45a7-93c8-eb8d984430c5" released by "_delete_snapshot" :: held 2.087s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" released by "delete_snapshot" :: held 2.120s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:32 devstack cinder-volume[86301]: WARNING cinder.quota [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1492942492 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1492942492, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:32 devstack cinder-volume[86301]: WARNING cinder.quota [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1492942492 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1492942492, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:32 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['5b5da524-1330-449b-b495-173a7208b4c0', '54a604ab-a13f-413a-9265-f9b5289043bf', '1a89f8b6-45bb-4747-bfb1-977ee834a0ce', '00b90083-b3b7-4dcb-8256-b395b6d52cdf'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:33 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81" returned: 0 in 0.606s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:02:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:02:33 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:02:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:33 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 Sep 28 15:02:33 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:33 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['7792e665-8c99-4157-a6fa-38c38419b147', 'ef70c0f0-b0f0-4279-a467-5d49fdb16040', '7dc43bdb-f461-46f8-b42f-8127ee6b6d05', '796306de-9313-4a8c-95e9-5da5501bb842'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0df40056-4541-41b6-b296-59505fd9b658 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 417673d1-04b2-4ab8-8ba5-33da8e83e47e: deleted successfully Sep 28 15:02:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" acquired by "delete_volume" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[32197c93-469c-4ee8-a104-d1a0aad72e52]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:35 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc Sep 28 15:02:35 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:36 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" returned: 0 in 0.961s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:36 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc Sep 28 15:02:36 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:37 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" returned: 0 in 0.809s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-9d2b0c70-bd0f-4680-b541-fcfcff7f17fc" released by "delete_volume" :: held 1.997s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-d755d8f6-3a1b-4726-a071-e56cdae3dceb" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-d755d8f6-3a1b-4726-a071-e56cdae3dceb" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:37 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b495f92a-5d8f-4f33-a13b-67f75f5812d5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:37 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb Sep 28 15:02:37 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:38 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb" returned: 0 in 0.845s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:38 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb Sep 28 15:02:38 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:39 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d755d8f6-3a1b-4726-a071-e56cdae3dceb" returned: 0 in 0.556s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-d755d8f6-3a1b-4726-a071-e56cdae3dceb" released by "delete_volume" :: held 1.597s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['7ef864a2-aa82-4e02-960d-a87f642be547'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:39 devstack cinder-volume[86301]: WARNING cinder.quota [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1492942492 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1492942492, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['fc5c059f-9b32-4ff8-bec6-9917016e6db4', '656ee102-40f9-4508-8dc0-98e4798afff6', 'ad61e379-c745-4121-aff2-e23e137c4478', '30adb748-2248-4a86-923c-af8fa6d38607'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['e8650a57-6192-438e-9ae2-4e23af361913', 'ff2ac635-c0fb-4bf7-9235-283d524ce77a', 'dad5c49b-6d84-4c5e-b068-9d2c18577150', '2888ef11-f500-4e73-9688-df947127fd4a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:39 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:39 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:40 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.882s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:40 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:40 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0a4c8281-a67b-4871-b489-8dc572335c93 tempest-GroupSnapshotsTest-1784411527 None] Delete group completed successfully. Sep 28 15:02:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7d80cd2e-17e2-4cd3-8560-6a3284c3c4c9 tempest-GroupSnapshotsTest-1784411527 None] Group tempest-GroupSnapshotsTest-Group-527202908: creating Sep 28 15:02:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7d80cd2e-17e2-4cd3-8560-6a3284c3c4c9 tempest-GroupSnapshotsTest-1784411527 None] Group tempest-GroupSnapshotsTest-Group-527202908: created successfully Sep 28 15:02:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7d80cd2e-17e2-4cd3-8560-6a3284c3c4c9 tempest-GroupSnapshotsTest-1784411527 None] Create group completed successfully. Sep 28 15:02:43 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" returned: 0 in 10.072s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81, size 1024.00 MB, duration 10.07 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:02:43 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Converted 1024.00 MB image at 101.65 MB/s Sep 28 15:02:43 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:43 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 Sep 28 15:02:43 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:43 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (2f9c66b6-3c3c-46e7-b4e8-adbddee54092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b36eab5-8ffc-4403-a5e1-04bb7b162e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" released by "_copy_volume_from_snapshot" :: held 11.700s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b36eab5-8ffc-4403-a5e1-04bb7b162e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1440694590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4d9e49-8561-4854-8968-36aea38d95a2,host='devstack@QuobyteHD#QuobyteHD',id=23bbb97e-25f8-4369-8622-44cd75fdc4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:43Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa8619cb-105d-4aad-82f1-52d5e2404b84),volume_type_id=aa8619cb-105d-4aad-82f1-52d5e2404b84)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94944395-5e4e-4e61-ad6e-b916e915187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94944395-5e4e-4e61-ad6e-b916e915187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a0c7a8-4eda-4169-b2ad-6e63aac38b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a0c7a8-4eda-4169-b2ad-6e63aac38b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23bbb97e-25f8-4369-8622-44cd75fdc4d7', 'volume_name': 'volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35689ee-6f56-41d1-bae4-085587883fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35689ee-6f56-41d1-bae4-085587883fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ee7cd1-ec0b-4795-9d05-2f5a34b54eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:43 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Volume 23bbb97e-25f8-4369-8622-44cd75fdc4d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7', 'volume_size': 1} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Acquiring lock "cinder-quobyte-ce91b052-2d80-4521-9fd2-ff35c9b05111" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-ce91b052-2d80-4521-9fd2-ff35c9b05111" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Deleting offline snapshot ce91b052-2d80-4521-9fd2-ff35c9b05111 of volume d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] snapshot_file for this snap is: volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53613d1-797c-4f20-a38a-ea4d767cf5b2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:43 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 Sep 28 15:02:43 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:44 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111" returned: 0 in 0.500s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d588a104-eb70-4ce0-9988-8ec6ec119f81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:44 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[903ec758-7e5d-464c-a03e-7d5cd710cabe]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:44 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 Sep 28 15:02:44 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:44 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81" returned: 0 in 0.630s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:44 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 Sep 28 15:02:44 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:45 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111" returned: 0 in 0.488s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:45 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111 Sep 28 15:02:45 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:45 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81.ce91b052-2d80-4521-9fd2-ff35c9b05111" returned: 0 in 0.374s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-ce91b052-2d80-4521-9fd2-ff35c9b05111" released by "_delete_snapshot" :: held 2.166s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.922s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.802s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Creating offline snapshot 20c61e27-ba99-493f-8571-951e2d9aa373 of volume e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b42cbe0-5bfd-4a25-9bfd-b9d919c1ba53]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c778cdb9-12b0-4dca-a5f5-8153083204cc tempest-GroupsV314Test-576654958 None] Create group from source-group-a66e8cee-5ada-442a-a032-b37fe81e6a93 completed successfully. Sep 28 15:02:46 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac Sep 28 15:02:46 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:46 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac" returned: 0 in 0.519s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:46 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 1G Sep 28 15:02:46 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:47 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 1G" returned: 0 in 0.763s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89ea5df-a74a-45cd-b35b-642596e78cac -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack sudo[89737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89ea5df-a74a-45cd-b35b-642596e78cac -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 Sep 28 15:02:47 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.389s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Acquiring lock "cinder-quobyte-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 8 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[31662a39-54e3-48ea-b667-2c142139d2a8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89ea5df-a74a-45cd-b35b-642596e78cac -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373" returned: 0 in 0.610s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:47 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:47 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 Sep 28 15:02:47 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:47 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 Sep 28 15:02:47 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:48 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373" returned: 0 in 0.342s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:48 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.info Sep 28 15:02:48 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:48 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" returned: 0 in 0.747s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:48 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7 Sep 28 15:02:48 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:48 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.info" returned: 0 in 0.388s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:48 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.info Sep 28 15:02:48 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:48 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" returned: 0 in 0.331s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-8eb49bd0-d8b0-4cce-a401-7856a85c1bb7" released by "delete_volume" :: held 1.167s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Created reservations ['cfc63a4f-e98f-4362-9ca2-5a82656f90e9'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:48 devstack cinder-volume[86301]: WARNING cinder.quota [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1279987514 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1279987514, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:48 devstack cinder-volume[86301]: WARNING cinder.quota [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1279987514 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1279987514, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:48 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.info" returned: 0 in 0.320s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.114s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.357s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c4d9e49-8561-4854-8968-36aea38d95a2,created_at=2026-09-28T13:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1440694590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c4d9e49-8561-4854-8968-36aea38d95a2,host='devstack@QuobyteHD#QuobyteHD',id=23bbb97e-25f8-4369-8622-44cd75fdc4d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29030375ac064c6ca57f62d79063af2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:02:43Z,use_quota=True,user_id='ab14ee0d16d045618c9083dea2c9c95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa8619cb-105d-4aad-82f1-52d5e2404b84),volume_type_id=aa8619cb-105d-4aad-82f1-52d5e2404b84)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Creating volume 23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:02:48 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:48 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Created reservations ['1aba8b76-6fa6-4078-bb3b-6e5f3ae46196', '919d23ee-db02-469d-bd3f-2997f869d4dd', '610fa09d-14bf-4a80-aa35-e1cc2a201933', '118c4f5a-0935-4498-a799-087705e9eada'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:49 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 1073741824 Sep 28 15:02:49 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8c09567c-8329-42f6-9c8d-127c9b16f979 tempest-GroupSnapshotsV319Test-1937029371 None] group_snapshot f92acbbe-3093-402f-8f68-e14e4bb85ef9: created successfully Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:49 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:49 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:49 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.363s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-015e00b5-0dc9-4cd5-8b20-8d3ecdf11e32 tempest-GroupsV314Test-576654958 None] Delete group completed successfully. Sep 28 15:02:49 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 1073741824" returned: 0 in 0.746s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:49 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 Sep 28 15:02:49 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:50 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7" returned: 0 in 0.295s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ee7cd1-ec0b-4795-9d05-2f5a34b54eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a25994-a776-4c8d-b2d1-ce9142cf83d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:02:50 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Volume volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 (23bbb97e-25f8-4369-8622-44cd75fdc4d7): created successfully Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a25994-a776-4c8d-b2d1-ce9142cf83d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Flow 'volume_create_manager' (2f9c66b6-3c3c-46e7-b4e8-adbddee54092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:02:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dc7abbe2-8122-45db-8962-41c7ddbaa120 tempest-GroupSnapshotsTest-1784411527 None] Created volume successfully. Sep 28 15:02:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] group_snapshot f92acbbe-3093-402f-8f68-e14e4bb85ef9: deleting Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] group_snapshot f92acbbe-3093-402f-8f68-e14e4bb85ef9: deleting {{(pid=86301) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Acquiring lock "cinder-quobyte-e89ea5df-a74a-45cd-b35b-642596e78cac" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "cinder-quobyte-e89ea5df-a74a-45cd-b35b-642596e78cac" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Acquiring lock "cinder-quobyte-20c61e27-ba99-493f-8571-951e2d9aa373" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "cinder-quobyte-20c61e27-ba99-493f-8571-951e2d9aa373" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Deleting offline snapshot 20c61e27-ba99-493f-8571-951e2d9aa373 of volume e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] snapshot_file for this snap is: volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1dc30b-1158-42e6-8c57-593a0f1243d6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:50 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 Sep 28 15:02:50 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Acquiring lock "cinder-quobyte-d588a104-eb70-4ce0-9988-8ec6ec119f81" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-d588a104-eb70-4ce0-9988-8ec6ec119f81" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbf0a24-66cc-42f6-a9ba-f2a3269c2ff2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:50 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373" returned: 0 in 0.567s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89ea5df-a74a-45cd-b35b-642596e78cac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[998eafcc-8010-4cf6-99b3-f7c6c3cbc31e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:51 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 Sep 28 15:02:51 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:51 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] GroupSnapshot 63cc86bd-ce95-4d76-b9a0-7e73571247b3: creating. Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Group snapshot 63cc86bd-ce95-4d76-b9a0-7e73571247b3: creating. {{(pid=86301) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Creating offline snapshot 23f24dcb-aa3c-4aa5-8233-b05a489cb067 of volume 23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:02:51 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac Sep 28 15:02:51 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f511fb-d2ce-4214-9ff7-f884f3d1af54]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:51 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 Sep 28 15:02:51 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:51 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81" returned: 0 in 0.706s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:51 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81 Sep 28 15:02:51 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:51 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac" returned: 0 in 0.675s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:51 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 Sep 28 15:02:51 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:51 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d588a104-eb70-4ce0-9988-8ec6ec119f81" returned: 0 in 0.330s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Lock "cinder-quobyte-d588a104-eb70-4ce0-9988-8ec6ec119f81" released by "delete_volume" :: held 1.164s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:51 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7" returned: 0 in 0.627s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:51 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 1G Sep 28 15:02:51 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Created reservations ['fdf223ee-3152-4b36-aaf2-21a0489cc6b5'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Created reservations ['40a86dfb-ff39-4a04-b0b3-225d0c964d8a', '15f2d37e-299d-4d81-ba86-ef44791ccfcb', '3d7c4d11-871b-4fc2-8b22-6168811efc59', 'b2f8a857-9c41-4dc7-bfc7-a53632d534a6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:52 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:52 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:52 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373" returned: 0 in 0.684s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:52 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373 Sep 28 15:02:52 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:52 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.342s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d27b053c-39b9-422e-8686-100f0d1801b2 tempest-GroupsV314Test-576654958 None] Delete group completed successfully. Sep 28 15:02:52 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 1G" returned: 0 in 0.796s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:52 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:52 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 Sep 28 15:02:52 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac.20c61e27-ba99-493f-8571-951e2d9aa373" returned: 0 in 0.370s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "cinder-quobyte-20c61e27-ba99-493f-8571-951e2d9aa373" released by "_delete_snapshot" :: held 2.474s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "cinder-quobyte-e89ea5df-a74a-45cd-b35b-642596e78cac" released by "delete_snapshot" :: held 2.533s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:52 devstack cinder-volume[86301]: WARNING cinder.quota [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-116042081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-116042081, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:52 devstack cinder-volume[86301]: WARNING cinder.quota [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-116042081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-116042081, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:52 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] Created reservations ['2b2d1e4f-a87e-4cb9-9eab-b2819d33b40b', 'd416141a-6ed1-44d1-b30b-0fe716f78b7a', 'b70e3dd8-b0a9-4b69-ab09-e649832f5784', '39a9a967-6593-44be-87b4-6222264af8be'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:53 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-86e04198-752e-4433-8efd-b43ea74ecf00 tempest-GroupSnapshotsV319Test-1937029371 None] group_snapshot f92acbbe-3093-402f-8f68-e14e4bb85ef9: deleted successfully Sep 28 15:02:53 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067" returned: 0 in 0.376s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:53 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:53 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 Sep 28 15:02:53 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:53 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067" returned: 0 in 0.328s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:53 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.info Sep 28 15:02:53 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:54 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.info" returned: 0 in 0.569s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:54 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:54 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.info Sep 28 15:02:54 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Acquiring lock "cinder-quobyte-e89ea5df-a74a-45cd-b35b-642596e78cac" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "cinder-quobyte-e89ea5df-a74a-45cd-b35b-642596e78cac" acquired by "delete_volume" :: waited 0.036s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c782dd-c189-46e3-8b7f-0e558fe860b3]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:54 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac Sep 28 15:02:54 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:54 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.info" returned: 0 in 0.609s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.458s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-46405fb5-0546-4736-b430-df14319743f0 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 63cc86bd-ce95-4d76-b9a0-7e73571247b3: created successfully Sep 28 15:02:55 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac" returned: 0 in 0.754s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:55 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac Sep 28 15:02:55 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:55 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e89ea5df-a74a-45cd-b35b-642596e78cac" returned: 0 in 0.487s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "cinder-quobyte-e89ea5df-a74a-45cd-b35b-642596e78cac" released by "delete_volume" :: held 1.439s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:55 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Created reservations ['230e7345-fed3-4544-85c6-0a648e53fde4'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:55 devstack cinder-volume[86301]: WARNING cinder.quota [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-116042081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-116042081, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:55 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Created reservations ['06a60a32-12ac-43ff-801f-70b8b2d1245e', '3b346e01-3cbf-4449-b677-d506274e69d2', 'a17370b8-8a3b-4a61-97a3-4fc6bcd7919d', '56c9ca71-743b-49fd-a143-c6828fc82b49'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 63cc86bd-ce95-4d76-b9a0-7e73571247b3: deleting Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 63cc86bd-ce95-4d76-b9a0-7e73571247b3: deleting {{(pid=86301) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-23bbb97e-25f8-4369-8622-44cd75fdc4d7" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-23bbb97e-25f8-4369-8622-44cd75fdc4d7" acquired by "delete_snapshot" :: waited 0.076s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-23f24dcb-aa3c-4aa5-8233-b05a489cb067" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:02:56 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:02:56 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-23f24dcb-aa3c-4aa5-8233-b05a489cb067" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Deleting offline snapshot 23f24dcb-aa3c-4aa5-8233-b05a489cb067 of volume 23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] snapshot_file for this snap is: volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5032dd01-211f-465f-91f6-4089fd55ac47]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:56 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 Sep 28 15:02:56 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:56 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.578s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:56 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:02:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-63a06324-42f3-4c46-bc85-6096b0a96003 tempest-GroupSnapshotsV319Test-1937029371 None] Delete group completed successfully. Sep 28 15:02:57 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067" returned: 0 in 0.829s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:02:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[744887a7-c603-467f-b6ed-c99a9a4db089]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:02:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:57 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 Sep 28 15:02:57 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:57 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7" returned: 0 in 0.640s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:57 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 Sep 28 15:02:57 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:58 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067" returned: 0 in 0.591s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:02:58 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067 Sep 28 15:02:58 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:02:58 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Sep 28 15:02:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7.23f24dcb-aa3c-4aa5-8233-b05a489cb067" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:02:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-23f24dcb-aa3c-4aa5-8233-b05a489cb067" released by "_delete_snapshot" :: held 2.694s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-23bbb97e-25f8-4369-8622-44cd75fdc4d7" released by "delete_snapshot" :: held 2.758s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:02:59 devstack cinder-volume[86301]: WARNING cinder.quota [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2094432677 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2094432677, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:59 devstack cinder-volume[86301]: WARNING cinder.quota [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2094432677 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2094432677, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:02:59 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['8af7ce54-3efe-4386-bfb4-3b1672ccf446', '7e6cf199-ed4c-421b-8d0d-bf2383addd78', '4cbee684-0c12-414e-bf0e-fac57683b673', '784647a5-1a15-4fdf-a4e4-1eba6404a67d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:02:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6e3f5e5e-ac6e-444c-a159-e24f14bb86c1 tempest-GroupSnapshotsTest-1784411527 None] group_snapshot 63cc86bd-ce95-4d76-b9a0-7e73571247b3: deleted successfully Sep 28 15:03:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "cinder-quobyte-23bbb97e-25f8-4369-8622-44cd75fdc4d7" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-23bbb97e-25f8-4369-8622-44cd75fdc4d7" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6fc860-a28d-40a0-9aac-6d902914c5e0]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:00 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 Sep 28 15:03:00 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:00 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7" returned: 0 in 0.596s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:00 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7 Sep 28 15:03:00 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:01 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-23bbb97e-25f8-4369-8622-44cd75fdc4d7" returned: 0 in 0.421s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Lock "cinder-quobyte-23bbb97e-25f8-4369-8622-44cd75fdc4d7" released by "delete_volume" :: held 1.173s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['bbeaa83b-10e9-408b-b44d-e2b9967d0bc1'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:01 devstack cinder-volume[86301]: WARNING cinder.quota [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2094432677 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2094432677, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Created reservations ['387c9076-7b67-4d04-a445-791b8daed735', '51c2544d-9d6c-46d7-aeaf-fd4c52929e17', '4dbc7199-9f2b-41aa-80cc-9a658748799d', 'ca2b1489-3366-41da-a2c3-ddfcb9a73631'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:01 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:03:01 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:02 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.312s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:02 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-61818b34-8654-4d5d-a485-abbc59d1d4a2 tempest-GroupSnapshotsTest-1784411527 None] Delete group completed successfully. Sep 28 15:03:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1568826b-c609-48a9-a39f-848aa80887db tempest-GroupsV320Test-845665171 None] Group tempest-GroupsV320Test-Group-432231837: creating Sep 28 15:03:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1568826b-c609-48a9-a39f-848aa80887db tempest-GroupsV320Test-845665171 None] Group tempest-GroupsV320Test-Group-432231837: created successfully Sep 28 15:03:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1568826b-c609-48a9-a39f-848aa80887db tempest-GroupsV320Test-845665171 None] Create group completed successfully. Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=128,cinder:INSERT=34,cinder:UPDATE=124,cinder:DELETE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Created reservations ['8dbfa54f-d082-49f9-9e10-95103d6479b6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:12 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:03:12 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:12 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.383s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:12 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:12 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4df60ff2-6ef5-46aa-ab26-cf25873176fb tempest-GroupsV320Test-845665171 None] Delete group completed successfully. Sep 28 15:03:22 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=124,cinder:UPDATE=122,cinder:DELETE=3,cinder:INSERT=23 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:22 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:INSERT=1,cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Flow 'volume_create_manager' (f261fd3a-ed60-4e86-b3f1-8605621de353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277b4016-e81d-4b8b-9d1e-b1ebad1fc09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277b4016-e81d-4b8b-9d1e-b1ebad1fc09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-815193258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2b32d3-8d13-4669-9714-dcb885a61a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6faef8480c24b1283422c6c41058cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:23Z,use_quota=True,user_id='91e1c0c9d83b4ea58a7e317bfb008613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe42fb26-49f1-4015-b02f-4b76225751a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe42fb26-49f1-4015-b02f-4b76225751a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43af1c4b-889d-4a88-bc0e-79ec60fdedf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43af1c4b-889d-4a88-bc0e-79ec60fdedf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e2b32d3-8d13-4669-9714-dcb885a61a8c', 'volume_name': 'volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdb7076-9a3c-4f4c-a444-a3ae0ba763ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdb7076-9a3c-4f4c-a444-a3ae0ba763ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb683b4-404f-46ed-827b-81e2fc1a1b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c', 'volume_size': 1} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-815193258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e2b32d3-8d13-4669-9714-dcb885a61a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6faef8480c24b1283422c6c41058cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:23Z,use_quota=True,user_id='91e1c0c9d83b4ea58a7e317bfb008613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Creating volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:03:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:23 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c 1073741824 Sep 28 15:03:23 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:24 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c 1073741824" returned: 0 in 0.883s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:24 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c Sep 28 15:03:24 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:24 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c" returned: 0 in 0.350s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffb683b4-404f-46ed-827b-81e2fc1a1b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73261803-9ec1-4700-a079-22df353bc4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Volume volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c (1e2b32d3-8d13-4669-9714-dcb885a61a8c): created successfully Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73261803-9ec1-4700-a079-22df353bc4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Flow 'volume_create_manager' (f261fd3a-ed60-4e86-b3f1-8605621de353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f42d474b-3fc2-46bd-8662-7225b57b9abc tempest-SnapshotsActionsTest-1262447316 None] Created volume successfully. Sep 28 15:03:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Creating offline snapshot 3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:25 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd81ee5d-25a9-4bdc-8bb6-61f19e411341]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:26 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c Sep 28 15:03:26 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:26 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c" returned: 0 in 0.660s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:26 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f 1G Sep 28 15:03:26 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f 1G" returned: 0 in 0.727s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:27 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:27 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.579s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:27 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f is being set with open permissions: ugo+rw Sep 28 15:03:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:27 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:27 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:28 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.382s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:28 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.info Sep 28 15:03:28 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Flow 'volume_create_manager' (038d3655-7dff-40ed-8771-159b29ae6ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145e2680-e921-48f0-a1ee-d94d4992fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145e2680-e921-48f0-a1ee-d94d4992fad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-179257717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b8518f-4789-43d2-9a9e-b92e474c0709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762d92d076754e7dab08df7ec44305c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:28Z,use_quota=True,user_id='1dd1ed5639f34ef78fefa310ca26e46a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5ac20-f987-4ea2-9f5a-079360f12260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe5ac20-f987-4ea2-9f5a-079360f12260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf467ef-694b-4207-a0b5-ba05b100869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf467ef-694b-4207-a0b5-ba05b100869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b8518f-4789-43d2-9a9e-b92e474c0709', 'volume_name': 'volume-84b8518f-4789-43d2-9a9e-b92e474c0709', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21913f37-0751-4b8f-8ad3-e2227acb89f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21913f37-0751-4b8f-8ad3-e2227acb89f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a1c8e-a8bb-4b3b-82c5-7ac5db46377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:28 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Volume 84b8518f-4789-43d2-9a9e-b92e474c0709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b8518f-4789-43d2-9a9e-b92e474c0709', 'volume_size': 1} Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:28 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.info" returned: 0 in 0.443s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:28 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.info is being set with open permissions: ugo+rw Sep 28 15:03:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:28 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.info Sep 28 15:03:28 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:29 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.info" returned: 0 in 0.324s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.271s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-179257717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b8518f-4789-43d2-9a9e-b92e474c0709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762d92d076754e7dab08df7ec44305c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:28Z,use_quota=True,user_id='1dd1ed5639f34ef78fefa310ca26e46a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Creating volume 84b8518f-4789-43d2-9a9e-b92e474c0709 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:29 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:29 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 1073741824 Sep 28 15:03:29 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bda453c6-2550-480e-a7dd-8286c2715028 tempest-SnapshotsActionsTest-1262447316 None] Create snapshot completed successfully Sep 28 15:03:29 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 1073741824" returned: 0 in 0.746s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:30 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 Sep 28 15:03:30 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:30 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709" returned: 0 in 0.453s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7a1c8e-a8bb-4b3b-82c5-7ac5db46377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b8518f-4789-43d2-9a9e-b92e474c0709', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205bd558-82c1-442a-a95c-e0370fe3b16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Volume volume-84b8518f-4789-43d2-9a9e-b92e474c0709 (84b8518f-4789-43d2-9a9e-b92e474c0709): created successfully Sep 28 15:03:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205bd558-82c1-442a-a95c-e0370fe3b16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Flow 'volume_create_manager' (038d3655-7dff-40ed-8771-159b29ae6ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d3dff45b-460f-4c83-a090-60c480d2a643 tempest-VolumesServicesTestJSON-202804408 None] Created volume successfully. Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Creating offline snapshot 6206905a-f612-411e-90fd-1db547516533 of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[effb578b-ec2f-4cf4-97e2-99f97850b810]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:31 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:31 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:31 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.596s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:31 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 1G Sep 28 15:03:31 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Acquiring lock "cinder-84b8518f-4789-43d2-9a9e-b92e474c0709-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Lock "cinder-84b8518f-4789-43d2-9a9e-b92e474c0709-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Acquiring lock "cinder-quobyte-84b8518f-4789-43d2-9a9e-b92e474c0709" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Lock "cinder-quobyte-84b8518f-4789-43d2-9a9e-b92e474c0709" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd749420-1632-4d8d-993d-4a3f679f339e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:32 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 Sep 28 15:03:32 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:32 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 1G" returned: 0 in 0.796s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:32 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 Sep 28 15:03:32 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:32 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709" returned: 0 in 0.640s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:33 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709 Sep 28 15:03:33 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:33 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:33 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 is being set with open permissions: ugo+rw Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:33 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 Sep 28 15:03:33 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:33 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-84b8518f-4789-43d2-9a9e-b92e474c0709" returned: 0 in 0.485s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Lock "cinder-quobyte-84b8518f-4789-43d2-9a9e-b92e474c0709" released by "delete_volume" :: held 1.199s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Created reservations ['e9abb19c-8eff-4419-afcf-c4d6b99c0cb9', 'd9fb450e-9248-4dc6-b075-8a071470c839', '77104c84-b885-4f74-bd47-585e962852f8', 'b517ad76-65e6-4913-af18-b0bb4143d668'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:33 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533" returned: 0 in 0.478s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:33 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:03:33 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-de1968bd-4654-42cb-b09e-73de8b42d7b9 tempest-SnapshotsActionsTest-1262447316 None] Create snapshot completed successfully Sep 28 15:03:34 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.361s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Deleted volume successfully. Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0b66115e-b476-455b-842a-03546ffed14a tempest-VolumesServicesTestJSON-202804408 None] Lock "cinder-84b8518f-4789-43d2-9a9e-b92e474c0709-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-6206905a-f612-411e-90fd-1db547516533-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-6206905a-f612-411e-90fd-1db547516533-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-6206905a-f612-411e-90fd-1db547516533" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-6206905a-f612-411e-90fd-1db547516533" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Deleting offline snapshot 6206905a-f612-411e-90fd-1db547516533 of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] snapshot_file for this snap is: volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a2cf75-ffa6-4703-abc7-cb6a8d5e72da]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:34 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 Sep 28 15:03:34 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:35 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533" returned: 0 in 0.552s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27fedc5-e0ec-43f6-aefe-7a69f389cece]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:35 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:35 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:35 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.520s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:35 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 Sep 28 15:03:35 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:36 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533" returned: 0 in 0.657s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:36 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533 Sep 28 15:03:36 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:36 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.6206905a-f612-411e-90fd-1db547516533" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-6206905a-f612-411e-90fd-1db547516533" released by "_delete_snapshot" :: held 2.286s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" released by "delete_snapshot" :: held 2.320s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:37 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Created reservations ['3b4cb118-c860-47e1-9b72-d930841d5737', 'aaaf227d-0de8-449e-acd8-8d22b91245f0', 'fccf2d61-5f8f-4cc2-8d2f-bc2a87fbaa82', 'c32c1ef9-ac2b-4781-a8cf-3523442898bf'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Delete snapshot completed successfully. Sep 28 15:03:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77189335-6d31-4d9a-9a43-56c6029f0b03 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-6206905a-f612-411e-90fd-1db547516533-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Creating offline snapshot 0716dde3-3059-4e0b-95f2-474e02759bb1 of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8992fd4c-9154-4290-b2da-e0eae7bd4b14]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:38 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:38 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:39 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.654s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:39 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 1G Sep 28 15:03:39 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 1G" returned: 0 in 0.779s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 Sep 28 15:03:40 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1" returned: 0 in 0.411s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 is being set with open permissions: ugo+rw Sep 28 15:03:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:40 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 Sep 28 15:03:40 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:40 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1" returned: 0 in 0.399s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ad71c40b-2c68-43eb-9e0f-c1dd36c5f02e tempest-SnapshotsActionsTest-1262447316 None] Create snapshot completed successfully Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-0716dde3-3059-4e0b-95f2-474e02759bb1-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-0716dde3-3059-4e0b-95f2-474e02759bb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-0716dde3-3059-4e0b-95f2-474e02759bb1" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-0716dde3-3059-4e0b-95f2-474e02759bb1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Deleting offline snapshot 0716dde3-3059-4e0b-95f2-474e02759bb1 of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] snapshot_file for this snap is: volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8df11e-56af-4a9c-a0cb-64483427d99a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 Sep 28 15:03:42 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:42 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1" returned: 0 in 0.580s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:42 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[baea4c9f-4e17-4968-83bf-5a9cf991ffef]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:42 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:42 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.548s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 Sep 28 15:03:43 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:43 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1" returned: 0 in 0.537s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:43 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1 Sep 28 15:03:43 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:44 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.0716dde3-3059-4e0b-95f2-474e02759bb1" returned: 0 in 0.397s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-0716dde3-3059-4e0b-95f2-474e02759bb1" released by "_delete_snapshot" :: held 2.233s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" released by "delete_snapshot" :: held 2.281s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Created reservations ['ba6f29e1-198e-4dff-b280-d287dddfe650', 'acfaac2c-0050-4d7f-b378-b5e721fdef2f', '02213a8c-f6a4-41c6-89ed-77464839a5f6', 'b4c7342c-e13f-48ba-9aaa-1ebe258afb7b'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Delete snapshot completed successfully. Sep 28 15:03:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebb56643-7613-4713-bc63-9e94846700f0 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-0716dde3-3059-4e0b-95f2-474e02759bb1-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Flow 'volume_create_manager' (225aa345-97bd-4305-8fb2-383ef94a67d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c556fa4-9ada-4401-8b61-9f0abed09acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c556fa4-9ada-4401-8b61-9f0abed09acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-393054209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b72e08c-4d31-4da2-b7d3-3e12526d41db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e845ccca3a48368038f1c0a28c705b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:46Z,use_quota=True,user_id='5ca150efd76c4afab5297c46f2f166a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05c5f14-c0b4-4c21-a5e5-e36191daca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05c5f14-c0b4-4c21-a5e5-e36191daca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5120647-a4c0-427c-9662-5d85c4e29016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5120647-a4c0-427c-9662-5d85c4e29016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b72e08c-4d31-4da2-b7d3-3e12526d41db', 'volume_name': 'volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6aff57-23e6-4bbf-bdfe-5f76468fd11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6aff57-23e6-4bbf-bdfe-5f76468fd11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc35c55-4542-4bbb-87f2-611cc93da6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:45 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Volume 5b72e08c-4d31-4da2-b7d3-3e12526d41db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db', 'volume_size': 1} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-393054209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b72e08c-4d31-4da2-b7d3-3e12526d41db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e845ccca3a48368038f1c0a28c705b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:46Z,use_quota=True,user_id='5ca150efd76c4afab5297c46f2f166a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Creating volume 5b72e08c-4d31-4da2-b7d3-3e12526d41db {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:45 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:03:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:45 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db 1073741824 Sep 28 15:03:45 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:46 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db 1073741824" returned: 0 in 0.866s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:46 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db Sep 28 15:03:46 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:47 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:03:47 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:47 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db" returned: 0 in 0.552s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.406s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc35c55-4542-4bbb-87f2-611cc93da6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b36f2a-1a1b-4c9c-abc3-ef23d5a2eb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Creating offline snapshot dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:47 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.464s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:47 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Volume volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db (5b72e08c-4d31-4da2-b7d3-3e12526d41db): created successfully Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b36f2a-1a1b-4c9c-abc3-ef23d5a2eb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Flow 'volume_create_manager' (225aa345-97bd-4305-8fb2-383ef94a67d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7616ddf4-9548-4115-ac08-c9cd2ee5df2c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 8 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:03:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:47 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-15782d86-8f89-4d86-8cea-3e9fbea4d976 tempest-ServerActionsTestOtherA-1449271014 None] Created volume successfully. Sep 28 15:03:47 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:47 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:48 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.679s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:48 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff 1G Sep 28 15:03:48 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:49 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff 1G" returned: 0 in 0.949s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:49 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff Sep 28 15:03:49 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:49 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" returned: 0 in 0.526s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:49 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff is being set with open permissions: ugo+rw Sep 28 15:03:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:49 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff Sep 28 15:03:49 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:50 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" returned: 0 in 0.364s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3a751493-cd36-4f1f-b47c-d5679d9925f7 tempest-SnapshotsActionsTest-1262447316 None] Create snapshot completed successfully Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Flow 'volume_create_manager' (95ccf789-99cb-4b62-8940-fa555507f9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42b0f1f-8202-4c52-95cd-02dddba6575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42b0f1f-8202-4c52-95cd-02dddba6575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-395811743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c41984f13984828a85727048732ab8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:51Z,use_quota=True,user_id='306b60c90b5f4a36aff29479ae2af951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be66c332-785c-4f46-8ffe-926a43af3da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be66c332-785c-4f46-8ffe-926a43af3da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85dddd40-52e1-4758-a665-100f8101432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85dddd40-52e1-4758-a665-100f8101432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c', 'volume_name': 'volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93beda5-8018-470e-bc6e-096d77be967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93beda5-8018-470e-bc6e-096d77be967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63dbb8b-accf-4a6f-b1ef-7995412ebd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:50 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Volume c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c', 'volume_size': 1} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-395811743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c41984f13984828a85727048732ab8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:51Z,use_quota=True,user_id='306b60c90b5f4a36aff29479ae2af951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Creating volume c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:50 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:03:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:50 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c 1073741824 Sep 28 15:03:50 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Deleting offline snapshot dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:03:51 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] snapshot_file for this snap is: volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c 1073741824" returned: 0 in 0.931s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[15816003-6f3a-409f-afe9-be76dd679f57]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:51 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c Sep 28 15:03:51 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:52 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff Sep 28 15:03:52 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:52 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c" returned: 0 in 0.482s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63dbb8b-accf-4a6f-b1ef-7995412ebd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd36475e-b4e7-4241-b0c0-77f980310f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Volume volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c (c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c): created successfully Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd36475e-b4e7-4241-b0c0-77f980310f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Flow 'volume_create_manager' (95ccf789-99cb-4b62-8940-fa555507f9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e485d461-f829-4be4-9831-d412fb203aa7 tempest-VolumeQuotasAdminTestJSON-650978660 None] Created volume successfully. Sep 28 15:03:52 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" returned: 0 in 0.738s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[142dc5cd-5959-44a7-b1da-f9437d122bfa]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:52 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:52 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Acquiring lock "cinder-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "cinder-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Acquiring lock "cinder-quobyte-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "cinder-quobyte-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c" acquired by "delete_volume" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[505257b1-c153-47b5-97d5-93d6707a21e4]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:53 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.758s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:53 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c Sep 28 15:03:53 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:53 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff Sep 28 15:03:53 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:53 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c" returned: 0 in 0.619s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:53 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c Sep 28 15:03:53 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:54 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" returned: 0 in 0.852s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:54 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff Sep 28 15:03:54 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:54 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c" returned: 0 in 0.505s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "cinder-quobyte-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c" released by "delete_volume" :: held 1.255s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Created reservations ['7890e80a-d389-4075-b325-a77f4af6bd30', '6f6847ae-4aa4-4d95-b0b8-316bb9c2e7ee', 'f894c55c-b020-4cb3-ba64-2ab756d8081f', '7f334788-c96e-4e5f-897c-eb4e0a06f03f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:54 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" returned: 0 in 0.529s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:54 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:03:54 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff" released by "_delete_snapshot" :: held 3.094s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" released by "delete_snapshot" :: held 3.162s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:55 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Created reservations ['ff7b2ba2-8328-457a-8a12-416d6982f79f', '257e0d0e-1e5f-4e85-b124-aefcf5640ac3', '58bfccd5-bb91-4db4-883c-9b1e3f87d2c6', '1974e40a-6ec9-47ce-93c4-6a1f9e88f9fb'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:03:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Delete snapshot completed successfully. Sep 28 15:03:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f87c849a-f03c-4f27-ab6d-3deccf493f65 tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-dc9f6dbc-dbeb-4a61-bd71-7a37f10d5dff-delete_snapshot" released by "delete_snapshot" :: held 3.630s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:55 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.583s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:55 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:03:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Deleted volume successfully. Sep 28 15:03:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed49910-90d5-4345-8f55-405b7d8a0084 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "cinder-c29bb20d-ed07-4c44-a5a3-d69b1ab0a06c-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Flow 'volume_create_manager' (4b1f1936-900b-47a6-802a-51c73348c287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c513e52-785b-43be-bd16-45d557fa8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c513e52-785b-43be-bd16-45d557fa8a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-122689015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e7d6c2-6a7f-467a-b212-7a7ba4962667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c41984f13984828a85727048732ab8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:56Z,use_quota=True,user_id='306b60c90b5f4a36aff29479ae2af951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081f7965-3ce7-4087-b7a0-a0abd2874f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081f7965-3ce7-4087-b7a0-a0abd2874f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f75b9c-ed59-4059-9a26-66734454fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f75b9c-ed59-4059-9a26-66734454fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e7d6c2-6a7f-467a-b212-7a7ba4962667', 'volume_name': 'volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f123fe-418e-42b0-813f-62ac7724c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f123fe-418e-42b0-813f-62ac7724c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa32519-6d23-41bd-a878-1c76acdeabdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:56 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Volume 65e7d6c2-6a7f-467a-b212-7a7ba4962667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667', 'volume_size': 1} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-122689015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e7d6c2-6a7f-467a-b212-7a7ba4962667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c41984f13984828a85727048732ab8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:56Z,use_quota=True,user_id='306b60c90b5f4a36aff29479ae2af951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Creating volume 65e7d6c2-6a7f-467a-b212-7a7ba4962667 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:03:56 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:56 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 1073741824 Sep 28 15:03:56 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:57 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 1073741824" returned: 0 in 0.663s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:57 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 Sep 28 15:03:57 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Flow 'volume_create_manager' (29b92f95-7812-4a7b-96af-d498fbd2ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10fea2c-9d58-465c-bd15-6b90b71c53c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10fea2c-9d58-465c-bd15-6b90b71c53c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1436278443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03b695d-6fcc-4fa5-8e85-95937f733efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb29e2f0eeb040a9ba3f608f74653bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:57Z,use_quota=True,user_id='6a0e238feb60466e96096babe3eb0cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817efb95-af2c-454e-b2ae-42a888aedcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817efb95-af2c-454e-b2ae-42a888aedcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d62a1b-26ee-4620-a022-d94d5c1ee809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d62a1b-26ee-4620-a022-d94d5c1ee809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03b695d-6fcc-4fa5-8e85-95937f733efb', 'volume_name': 'volume-d03b695d-6fcc-4fa5-8e85-95937f733efb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5177e1-955e-4070-9914-dc32fc19c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5177e1-955e-4070-9914-dc32fc19c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a3cf94-59c2-4880-af9f-df42fe4fa44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Volume d03b695d-6fcc-4fa5-8e85-95937f733efb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03b695d-6fcc-4fa5-8e85-95937f733efb', 'volume_size': 1} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667" returned: 0 in 0.382s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.897s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Creating offline snapshot 105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa32519-6d23-41bd-a878-1c76acdeabdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40b145d-e37e-4a61-b632-054376201696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba1348-ef1a-4a79-a516-73d64d1295b2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Volume volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 (65e7d6c2-6a7f-467a-b212-7a7ba4962667): created successfully Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40b145d-e37e-4a61-b632-054376201696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:03:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Flow 'volume_create_manager' (4b1f1936-900b-47a6-802a-51c73348c287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:03:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-efa63c81-fbfd-44f5-a67b-e93d0b631079 tempest-VolumeQuotasAdminTestJSON-650978660 None] Created volume successfully. Sep 28 15:03:57 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:03:57 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:58 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.753s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:03:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:58 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 1G Sep 28 15:03:58 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:59 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Sep 28 15:03:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 1G" returned: 0 in 0.992s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:03:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:03:59 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 Sep 28 15:03:59 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:03:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5e123f42-cf3f-40e0-adfb-745ed45c2c99 tempest-VolumeQuotasAdminTestJSON-1679258864 None] Transfer volume completed successfully. Sep 28 15:04:00 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" returned: 0 in 0.808s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:00 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 is being set with open permissions: ugo+rw Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:00 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 Sep 28 15:04:00 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:00 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" returned: 0 in 0.377s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.142s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1436278443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03b695d-6fcc-4fa5-8e85-95937f733efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb29e2f0eeb040a9ba3f608f74653bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:03:57Z,use_quota=True,user_id='6a0e238feb60466e96096babe3eb0cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Creating volume d03b695d-6fcc-4fa5-8e85-95937f733efb {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:00 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Acquiring lock "cinder-65e7d6c2-6a7f-467a-b212-7a7ba4962667-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:00 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb 1073741824 Sep 28 15:04:00 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Lock "cinder-65e7d6c2-6a7f-467a-b212-7a7ba4962667-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9671da6f-d0ad-4c55-8665-8c7074337d92 tempest-SnapshotsActionsTest-1262447316 None] Create snapshot completed successfully Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Acquiring lock "cinder-quobyte-65e7d6c2-6a7f-467a-b212-7a7ba4962667" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Lock "cinder-quobyte-65e7d6c2-6a7f-467a-b212-7a7ba4962667" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd85ae7a-416b-4e42-91b8-699e06978092]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 Sep 28 15:04:01 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-105fbe7f-2209-4f2a-9e9c-7a627e8da6e0-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-105fbe7f-2209-4f2a-9e9c-7a627e8da6e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Acquiring lock "cinder-quobyte-105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Deleting offline snapshot 105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] snapshot_file for this snap is: volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e1a03-6672-43d9-a1b5-012ce2b8b118]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 Sep 28 15:04:01 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:01 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:01 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667" returned: 0 in 0.819s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb 1073741824" returned: 0 in 1.082s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:01 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667 Sep 28 15:04:01 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:01 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb Sep 28 15:04:02 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:02 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65e7d6c2-6a7f-467a-b212-7a7ba4962667" returned: 0 in 0.565s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" returned: 0 in 0.880s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Lock "cinder-quobyte-65e7d6c2-6a7f-467a-b212-7a7ba4962667" released by "delete_volume" :: held 1.528s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa51597-90c8-4d83-8381-91182fb59572]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:02 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb" returned: 0 in 0.553s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60a3cf94-59c2-4880-af9f-df42fe4fa44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03b695d-6fcc-4fa5-8e85-95937f733efb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e3a19c-a395-4244-97d0-42b435e6236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Volume volume-d03b695d-6fcc-4fa5-8e85-95937f733efb (d03b695d-6fcc-4fa5-8e85-95937f733efb): created successfully Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e3a19c-a395-4244-97d0-42b435e6236d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Flow 'volume_create_manager' (29b92f95-7812-4a7b-96af-d498fbd2ed62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a72b478d-e93a-4817-bee0-2812835e2a64 tempest-VolumesListAdminTestJSON-798730814 None] Created volume successfully. Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Created reservations ['27ce84b9-1495-4efc-8b0c-883ee81d5fb0', 'd59bc104-3173-47ae-8d50-b56491542339', '383c161b-a421-4bb5-8810-685dfc18634d', '51b7760e-ec68-4bf0-8e8c-a4cbae851ac5'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:02 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:04:02 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:02 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:02 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:03 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.501s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:03 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Deleted volume successfully. Sep 28 15:04:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a76bee7-d8e7-4b50-b84f-3d5f289ffce9 tempest-VolumeQuotasAdminTestJSON-1768887082 None] Lock "cinder-65e7d6c2-6a7f-467a-b212-7a7ba4962667-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:03 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.969s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:03 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 Sep 28 15:04:03 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Flow 'volume_create_manager' (01eb3482-6042-447f-8988-5becce8473ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffacba71-5b40-4f40-8294-96860b0c8dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffacba71-5b40-4f40-8294-96860b0c8dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-301890823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d328934-0604-4cf6-9147-45b25a6fed41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb29e2f0eeb040a9ba3f608f74653bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:04Z,use_quota=True,user_id='6a0e238feb60466e96096babe3eb0cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08660f6c-1ac7-4428-8ca5-e39611a55134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08660f6c-1ac7-4428-8ca5-e39611a55134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705e4ffd-6844-41a9-a48c-7bc02947215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705e4ffd-6844-41a9-a48c-7bc02947215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d328934-0604-4cf6-9147-45b25a6fed41', 'volume_name': 'volume-8d328934-0604-4cf6-9147-45b25a6fed41', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496a8347-2b1e-4297-9c12-4e17107a77db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496a8347-2b1e-4297-9c12-4e17107a77db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:04 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e042054a-7a0d-40b0-9ac5-4312f2bcc74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:04 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Volume 8d328934-0604-4cf6-9147-45b25a6fed41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d328934-0604-4cf6-9147-45b25a6fed41', 'volume_size': 1} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-301890823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d328934-0604-4cf6-9147-45b25a6fed41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb29e2f0eeb040a9ba3f608f74653bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:04Z,use_quota=True,user_id='6a0e238feb60466e96096babe3eb0cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Creating volume 8d328934-0604-4cf6-9147-45b25a6fed41 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:04 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" returned: 0 in 1.176s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:04 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0 Sep 28 15:04:04 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:04 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 1073741824 Sep 28 15:04:04 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:05 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" returned: 0 in 0.462s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-105fbe7f-2209-4f2a-9e9c-7a627e8da6e0" released by "_delete_snapshot" :: held 3.735s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" released by "delete_snapshot" :: held 3.775s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:05 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Created reservations ['6dbab96e-7bc8-44eb-84a9-121f9d2fd7cf', '67d7eb59-23ef-4839-948e-28486c98c698', 'f4e732b6-dd18-4ec3-8d64-cfbe737a1d6a', '4b326f65-0fb3-4a75-beda-15c0e6733fb4'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Delete snapshot completed successfully. Sep 28 15:04:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f8d9701b-4b42-4804-9f97-1781cd9ab1fc tempest-SnapshotsActionsTest-344189771 None] Lock "cinder-105fbe7f-2209-4f2a-9e9c-7a627e8da6e0-delete_snapshot" released by "delete_snapshot" :: held 4.094s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:05 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 1073741824" returned: 0 in 0.980s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:05 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 Sep 28 15:04:05 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:06 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41" returned: 0 in 0.397s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e042054a-7a0d-40b0-9ac5-4312f2bcc74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d328934-0604-4cf6-9147-45b25a6fed41', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16cf5ec-5a17-4133-a3eb-d80a23faf2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:06 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Volume volume-8d328934-0604-4cf6-9147-45b25a6fed41 (8d328934-0604-4cf6-9147-45b25a6fed41): created successfully Sep 28 15:04:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16cf5ec-5a17-4133-a3eb-d80a23faf2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Flow 'volume_create_manager' (01eb3482-6042-447f-8988-5becce8473ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4cb8f26c-aaa0-4d5c-afd6-b55679daa9c2 tempest-VolumesListAdminTestJSON-798730814 None] Created volume successfully. Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "cinder-3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "cinder-quobyte-3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-quobyte-3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Deleting offline snapshot 3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f of volume 1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] snapshot_file for this snap is: volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d74bf0-35c7-4adc-94ce-b3fb36b2cd42]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:07 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:04:07 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Flow 'volume_create_manager' (bc45209f-cd4f-46ab-bdf0-97861ccfa33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe58edc4-267e-4541-8d16-68cb6e9e3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe58edc4-267e-4541-8d16-68cb6e9e3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-708512824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6650008-0776-49e9-a457-92695a99e537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb29e2f0eeb040a9ba3f608f74653bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:08Z,use_quota=True,user_id='6a0e238feb60466e96096babe3eb0cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4a99e7-8d02-4275-91a3-329fa195939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b4a99e7-8d02-4275-91a3-329fa195939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3129c673-12ca-4ba0-a4d1-d7c4da7b6b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3129c673-12ca-4ba0-a4d1-d7c4da7b6b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6650008-0776-49e9-a457-92695a99e537', 'volume_name': 'volume-f6650008-0776-49e9-a457-92695a99e537', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4ec79c-8ea2-4536-98de-f00900b0963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4ec79c-8ea2-4536-98de-f00900b0963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c469b44-686b-4d75-bfeb-141e895c037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Volume f6650008-0776-49e9-a457-92695a99e537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6650008-0776-49e9-a457-92695a99e537', 'volume_size': 1} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-708512824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6650008-0776-49e9-a457-92695a99e537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb29e2f0eeb040a9ba3f608f74653bab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:08Z,use_quota=True,user_id='6a0e238feb60466e96096babe3eb0cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Creating volume f6650008-0776-49e9-a457-92695a99e537 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:08 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:08 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.743s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:04:08 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 1073741824 Sep 28 15:04:08 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9694f7-d111-410f-87df-9e4ab8436b12]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:08 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c Sep 28 15:04:08 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:08 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c" returned: 0 in 0.700s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:08 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:04:08 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:08 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 1073741824" returned: 0 in 0.843s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:09 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 Sep 28 15:04:09 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:09 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537" returned: 0 in 0.396s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c469b44-686b-4d75-bfeb-141e895c037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6650008-0776-49e9-a457-92695a99e537', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06359805-057d-44ce-a214-55e12093dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:09 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Volume volume-f6650008-0776-49e9-a457-92695a99e537 (f6650008-0776-49e9-a457-92695a99e537): created successfully Sep 28 15:04:09 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06359805-057d-44ce-a214-55e12093dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Flow 'volume_create_manager' (bc45209f-cd4f-46ab-bdf0-97861ccfa33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.599s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-427edc13-7809-4d74-8545-e7dcde36e990 tempest-VolumesListAdminTestJSON-798730814 None] Created volume successfully. Sep 28 15:04:09 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f Sep 28 15:04:09 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:09 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c.3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" returned: 0 in 0.351s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-quobyte-3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f" released by "_delete_snapshot" :: held 2.581s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" released by "delete_snapshot" :: held 2.659s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Created reservations ['350a748a-d07f-422f-aba5-7ec8ec833409', '1e5dafd0-b677-4773-aa5b-dbd7a4e7953b', '107190cd-a8f0-4196-822c-859ad96ff1c3', 'a2c561d1-4de7-4d1f-8815-bb0e7661c83c'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Delete snapshot completed successfully. Sep 28 15:04:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1b5aae5c-c505-4db4-8cfa-e4afbf656179 tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-3efc8d1b-d1ae-4ee3-9693-d98ab4854f6f-delete_snapshot" released by "delete_snapshot" :: held 2.911s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "cinder-1e2b32d3-8d13-4669-9714-dcb885a61a8c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-1e2b32d3-8d13-4669-9714-dcb885a61a8c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:10 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99f27a-714e-4337-979f-33ca67739da0]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:11 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c Sep 28 15:04:11 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:11 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c" returned: 0 in 0.628s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:11 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c Sep 28 15:04:11 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Flow 'volume_create_manager' (d949296d-8101-4f93-a3a9-420252569172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323f45f6-097b-45b0-ac38-b26d0adee311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (323f45f6-097b-45b0-ac38-b26d0adee311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd7c899-6e87-460d-a24e-59203191823d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bd9fd75f8f464b8b65851423e083ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:12Z,use_quota=True,user_id='a4cea91e6ac949c3950df1d3620b6f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea48dc5e-48d3-496f-b813-cced745a1812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea48dc5e-48d3-496f-b813-cced745a1812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7153ec-ac70-4e97-b194-bbe031fe1a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7153ec-ac70-4e97-b194-bbe031fe1a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd7c899-6e87-460d-a24e-59203191823d', 'volume_name': 'volume-3fd7c899-6e87-460d-a24e-59203191823d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169bcb57-cefa-424d-816d-1e793928de3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169bcb57-cefa-424d-816d-1e793928de3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedd2850-1049-4124-92ef-60a8ecd2d3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:11 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Volume 3fd7c899-6e87-460d-a24e-59203191823d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd7c899-6e87-460d-a24e-59203191823d', 'volume_size': 1} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd7c899-6e87-460d-a24e-59203191823d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bd9fd75f8f464b8b65851423e083ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:12Z,use_quota=True,user_id='a4cea91e6ac949c3950df1d3620b6f08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Creating volume 3fd7c899-6e87-460d-a24e-59203191823d {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:11 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:11 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1e2b32d3-8d13-4669-9714-dcb885a61a8c" returned: 0 in 0.516s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:12 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d 1073741824 Sep 28 15:04:12 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-quobyte-1e2b32d3-8d13-4669-9714-dcb885a61a8c" released by "delete_volume" :: held 1.281s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Created reservations ['c6ce7021-c6d8-4479-94b6-469de2b3468b', '98677cae-af8d-4e90-be29-c77ff132e5da', '4538ce4b-01ea-4312-a660-642f51941a0b', '17d09635-c68a-4b30-8014-6d965b6b0f23'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:12 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:12 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:12 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.338s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:12 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Deleted volume successfully. Sep 28 15:04:12 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d 1073741824" returned: 0 in 0.648s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-35cc99b0-6dd6-400c-a6b8-dd0edce0e2cd tempest-SnapshotsActionsTest-1262447316 None] Lock "cinder-1e2b32d3-8d13-4669-9714-dcb885a61a8c-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:12 devstack sudo[90454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d Sep 28 15:04:12 devstack sudo[90454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:13 devstack sudo[90454]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d" returned: 0 in 0.360s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedd2850-1049-4124-92ef-60a8ecd2d3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd7c899-6e87-460d-a24e-59203191823d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ede35ee-d505-4288-b77d-7908970dd907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Volume volume-3fd7c899-6e87-460d-a24e-59203191823d (3fd7c899-6e87-460d-a24e-59203191823d): created successfully Sep 28 15:04:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ede35ee-d505-4288-b77d-7908970dd907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Flow 'volume_create_manager' (d949296d-8101-4f93-a3a9-420252569172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8a989a0b-9a0c-4ef5-8102-8e3e3d515a54 tempest-VolumesListAdminTestJSON-1740522669 None] Created volume successfully. Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Acquiring lock "cinder-3fd7c899-6e87-460d-a24e-59203191823d-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "cinder-3fd7c899-6e87-460d-a24e-59203191823d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Acquiring lock "cinder-quobyte-3fd7c899-6e87-460d-a24e-59203191823d" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "cinder-quobyte-3fd7c899-6e87-460d-a24e-59203191823d" acquired by "delete_volume" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e77ecfc-359b-4008-aba7-ff475f4abc87]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "cinder-f6650008-0776-49e9-a457-92695a99e537-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-f6650008-0776-49e9-a457-92695a99e537-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "cinder-quobyte-f6650008-0776-49e9-a457-92695a99e537" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-quobyte-f6650008-0776-49e9-a457-92695a99e537" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:14 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c96f0d-e0f0-4e0b-906d-833805fd8fae]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:14 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:14 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 Sep 28 15:04:14 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d" returned: 0 in 0.799s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d Sep 28 15:04:15 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537" returned: 0 in 0.770s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:15 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537 Sep 28 15:04:15 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:15 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3fd7c899-6e87-460d-a24e-59203191823d" returned: 0 in 0.456s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "cinder-quobyte-3fd7c899-6e87-460d-a24e-59203191823d" released by "delete_volume" :: held 1.373s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Created reservations ['ef5a8688-a2b2-41a3-8e66-5bc004eeacfb', '25bcc91d-b264-4684-b398-86eb7bc46c92', '1b4de8f2-27d4-40a5-88ce-7564d30af2ab', '55cf31cc-122e-463d-abc3-8756878b304c'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:15 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f6650008-0776-49e9-a457-92695a99e537" returned: 0 in 0.449s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-quobyte-f6650008-0776-49e9-a457-92695a99e537" released by "delete_volume" :: held 1.313s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:16 devstack sudo[90541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:16 devstack sudo[90541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Created reservations ['e3ecb8f7-f135-4d9f-a173-86bcd5db5700', 'ed89a701-1fd8-4f41-a0d3-b9a7c57b146c', '97202e63-9128-4738-8060-e356a5f9553b', 'e4f5872a-d7c3-4e2a-bce5-964709307f27'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:16 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:16 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:16 devstack sudo[90541]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.595s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Deleted volume successfully. Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e559562a-bd0c-4193-8187-1a1208110763 tempest-VolumesListAdminTestJSON-1740522669 None] Lock "cinder-3fd7c899-6e87-460d-a24e-59203191823d-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:16 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Deleted volume successfully. Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3c8c37d0-4270-4e19-a2f8-81158a7b1e59 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-f6650008-0776-49e9-a457-92695a99e537-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "cinder-8d328934-0604-4cf6-9147-45b25a6fed41-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-8d328934-0604-4cf6-9147-45b25a6fed41-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "cinder-quobyte-8d328934-0604-4cf6-9147-45b25a6fed41" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-quobyte-8d328934-0604-4cf6-9147-45b25a6fed41" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[11612ca5-cbad-4cb2-b382-64fadb381cea]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:17 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 Sep 28 15:04:17 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:17 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41" returned: 0 in 0.478s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:17 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41 Sep 28 15:04:17 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:17 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8d328934-0604-4cf6-9147-45b25a6fed41" returned: 0 in 0.426s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-quobyte-8d328934-0604-4cf6-9147-45b25a6fed41" released by "delete_volume" :: held 0.969s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Created reservations ['86d9d436-936e-4af9-bb15-13d107cb221b', '2c9d1259-2938-4517-99cc-cfae10151465', '27cbb82b-198b-47cd-9950-20644e07bb07', '05924552-b68e-42e0-bf1c-9e3d3ad3e1e4'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:18 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:18 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:18 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.391s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:18 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Deleted volume successfully. Sep 28 15:04:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1fd91a04-fc27-47de-93e6-7179d08f39d2 tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-8d328934-0604-4cf6-9147-45b25a6fed41-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "cinder-d03b695d-6fcc-4fa5-8e85-95937f733efb-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-d03b695d-6fcc-4fa5-8e85-95937f733efb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "cinder-quobyte-d03b695d-6fcc-4fa5-8e85-95937f733efb" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-quobyte-d03b695d-6fcc-4fa5-8e85-95937f733efb" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:19 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fcb3c0-87bf-48c4-ba10-b1886c29f6fb]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:19 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb Sep 28 15:04:19 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:20 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb" returned: 0 in 0.590s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:20 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb Sep 28 15:04:20 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:20 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d03b695d-6fcc-4fa5-8e85-95937f733efb" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-quobyte-d03b695d-6fcc-4fa5-8e85-95937f733efb" released by "delete_volume" :: held 1.106s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Created reservations ['4e7ef5c4-343b-4b19-b5de-9bed5f2a60c2', '15788c82-c17f-4f63-9056-2c4beaa069ad', '09465e18-edfb-4181-b08b-b6a853c8e7ae', '48d3c273-0968-41c0-892c-cf05aa85af84'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:20 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:20 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:21 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.324s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:21 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Deleted volume successfully. Sep 28 15:04:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cb078e13-cffb-46cd-9d7d-dc691ee60c3f tempest-VolumesListAdminTestJSON-798730814 None] Lock "cinder-d03b695d-6fcc-4fa5-8e85-95937f733efb-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=129,cinder:SELECT=103,cinder:DELETE=14,cinder:INSERT=32 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=90,cinder:INSERT=30,cinder:UPDATE=119,cinder:DELETE=8 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:04:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-880a4654-c204-461c-b27f-2d1e65fe70dd req-6ed9cd23-3ad8-476e-aedf-aaefa3d79b79 tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-880a4654-c204-461c-b27f-2d1e65fe70dd req-6ed9cd23-3ad8-476e-aedf-aaefa3d79b79 tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-880a4654-c204-461c-b27f-2d1e65fe70dd req-6ed9cd23-3ad8-476e-aedf-aaefa3d79b79 tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-880a4654-c204-461c-b27f-2d1e65fe70dd req-6ed9cd23-3ad8-476e-aedf-aaefa3d79b79 tempest-ServerActionsTestOtherA-1449271014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '416f3b63-258b-458a-bc54-286dd91831da', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-880a4654-c204-461c-b27f-2d1e65fe70dd req-6ed9cd23-3ad8-476e-aedf-aaefa3d79b79 tempest-ServerActionsTestOtherA-1449271014 None] attachment_update completed successfully. Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Flow 'volume_create_manager' (0ff544ac-8d14-4277-a767-e20eaf6e4f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64269003-e670-41f3-9a8a-e6136a045f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64269003-e670-41f3-9a8a-e6136a045f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1596556465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd55e629-8346-4aac-93a9-191c9d3a2d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73457e06e9a14c46acdce3f28abc9024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:33Z,use_quota=True,user_id='77bd987ed45a4e61b1659f1f72f09b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5f5ebc-e57d-46a7-b441-858c8515e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5f5ebc-e57d-46a7-b441-858c8515e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c9f463-0148-4fcc-ba64-bc4028b95034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:04:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-f7cf395d-407e-4671-bb0c-c0c46a7c1ced req-9c202e45-c670-4ee8-a8fc-31442100fb39 tempest-ServerActionsTestOtherA-1449271014 None] Terminate volume connection completed successfully. Sep 28 15:04:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-f7cf395d-407e-4671-bb0c-c0c46a7c1ced req-9c202e45-c670-4ee8-a8fc-31442100fb39 tempest-ServerActionsTestOtherA-1449271014 None] Deleting attachment 416f3b63-258b-458a-bc54-286dd91831da. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:04:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-f7cf395d-407e-4671-bb0c-c0c46a7c1ced req-1301c1bd-8b22-4f38-8e99-d1633cedc38c tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-f7cf395d-407e-4671-bb0c-c0c46a7c1ced req-1301c1bd-8b22-4f38-8e99-d1633cedc38c tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-f7cf395d-407e-4671-bb0c-c0c46a7c1ced req-1301c1bd-8b22-4f38-8e99-d1633cedc38c tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-f7cf395d-407e-4671-bb0c-c0c46a7c1ced req-1301c1bd-8b22-4f38-8e99-d1633cedc38c tempest-ServerActionsTestOtherA-1449271014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee251c45-52f3-465a-9ef7-80aa945b8b57', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:04:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-f7cf395d-407e-4671-bb0c-c0c46a7c1ced req-1301c1bd-8b22-4f38-8e99-d1633cedc38c tempest-ServerActionsTestOtherA-1449271014 None] attachment_update completed successfully. Sep 28 15:04:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3c9f463-0148-4fcc-ba64-bc4028b95034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd55e629-8346-4aac-93a9-191c9d3a2d26', 'volume_name': 'volume-dd55e629-8346-4aac-93a9-191c9d3a2d26', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a22d7e1-c728-479b-99fe-a48263f65c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a22d7e1-c728-479b-99fe-a48263f65c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a763d1-e220-4e3d-b632-a1414664d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:35 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Volume dd55e629-8346-4aac-93a9-191c9d3a2d26: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd55e629-8346-4aac-93a9-191c9d3a2d26', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:04:35 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Trying to clone dd55e629-8346-4aac-93a9-191c9d3a2d26 from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:04:35 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:04:35 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:04:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f47fb2-0064-4b4b-9c5c-ca7ac981ee8b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:36 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD Sep 28 15:04:36 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:36 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:36 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c is fetched for user 77bd987ed45a4e61b1659f1f72f09b65. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:04:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[746acb86-3a55-4276-b6ab-efc9b0b9c6fd]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:36 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD Sep 28 15:04:36 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:37 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD" returned: 0 in 0.573s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1596556465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd55e629-8346-4aac-93a9-191c9d3a2d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73457e06e9a14c46acdce3f28abc9024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:33Z,use_quota=True,user_id='77bd987ed45a4e61b1659f1f72f09b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Creating volume dd55e629-8346-4aac-93a9-191c9d3a2d26 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:37 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:37 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 1073741824 Sep 28 15:04:37 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:38 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 1073741824" returned: 0 in 0.925s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:38 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 Sep 28 15:04:38 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:38 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26" returned: 0 in 0.560s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:38 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Attempting download of 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume dd55e629-8346-4aac-93a9-191c9d3a2d26. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:04:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb67d28-4b2b-4c7e-9906-54e58f037f95]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cg2eq5wf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:39 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cg2eq5wf Sep 28 15:04:39 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:39 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cg2eq5wf" returned: 0 in 0.680s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cg2eq5wf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:39 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cg2eq5wf Sep 28 15:04:39 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:40 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cg2eq5wf" returned: 1 in 0.783s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cg2eq5wf' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:04:40 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fcbf4a-645a-44ab-b380-5fd0e0428577]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:40 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD Sep 28 15:04:40 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:41 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:41 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c was qcow2, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:04:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:41 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 Sep 28 15:04:41 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:45 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26" returned: 0 in 3.983s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:45 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_wpu39chydevstack@QuobyteHD, size 112.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:04:45 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Converted 112.00 MB image at 28.11 MB/s Sep 28 15:04:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:45 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 1G Sep 28 15:04:45 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:46 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 1G" returned: 0 in 0.730s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Downloaded image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume dd55e629-8346-4aac-93a9-191c9d3a2d26 successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c for user 77bd987ed45a4e61b1659f1f72f09b65 is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Marking volume dd55e629-8346-4aac-93a9-191c9d3a2d26 as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Copying metadata from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c to dd55e629-8346-4aac-93a9-191c9d3a2d26. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Creating volume glance metadata for volume dd55e629-8346-4aac-93a9-191c9d3a2d26 backed by image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a763d1-e220-4e3d-b632-a1414664d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd55e629-8346-4aac-93a9-191c9d3a2d26', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2698d782-0df8-4778-afe1-d715e76a6c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:46 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Volume volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 (dd55e629-8346-4aac-93a9-191c9d3a2d26): created successfully Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2698d782-0df8-4778-afe1-d715e76a6c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Flow 'volume_create_manager' (0ff544ac-8d14-4277-a767-e20eaf6e4f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4cb96669-719c-49d0-88d7-955fbbf7f2c5 tempest-VolumesImageMetadata-1028567042 None] Created volume successfully. Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:47 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:47 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:47 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.571s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:04:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:04:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Acquiring lock "cinder-dd55e629-8346-4aac-93a9-191c9d3a2d26-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Lock "cinder-dd55e629-8346-4aac-93a9-191c9d3a2d26-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Acquiring lock "cinder-quobyte-dd55e629-8346-4aac-93a9-191c9d3a2d26" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:04:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Lock "cinder-quobyte-dd55e629-8346-4aac-93a9-191c9d3a2d26" acquired by "delete_volume" :: waited 0.047s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:04:48 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f15fc6-2f33-4c4b-be04-6ece779f3d11]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:04:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:48 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 Sep 28 15:04:48 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:49 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26" returned: 0 in 0.777s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:49 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26 Sep 28 15:04:49 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:49 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-dd55e629-8346-4aac-93a9-191c9d3a2d26" returned: 0 in 0.657s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Lock "cinder-quobyte-dd55e629-8346-4aac-93a9-191c9d3a2d26" released by "delete_volume" :: held 1.529s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Created reservations ['12671a5a-2cfe-47e4-92c0-edd2b49344b0', '4f8b1102-afee-4c7d-8540-9e86793bb706', 'd948dd83-d91b-47a7-9efa-63177c12c881', 'ce00bc01-946e-4988-a6cc-dbf0b9073efa'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:50 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:04:50 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:50 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.591s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:04:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Deleted volume successfully. Sep 28 15:04:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bef34bdd-6bb6-44ae-ac66-fb4fc2cb312d tempest-VolumesImageMetadata-1028567042 None] Lock "cinder-dd55e629-8346-4aac-93a9-191c9d3a2d26-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Flow 'volume_create_manager' (50960a41-a050-4163-9f01-dcc85c4015b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267b8dec-8e7b-4286-8058-d996da052b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (267b8dec-8e7b-4286-8058-d996da052b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044308821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca90ac7-96f0-4a51-96e7-ffaa321619f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0686dd2431024e57a749b3b30fa962ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:56Z,use_quota=True,user_id='f887e9e00bd54e81ad8c7a382c280876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21452f99-33e1-4bf1-8fe6-da164e584c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21452f99-33e1-4bf1-8fe6-da164e584c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d620f23a-729a-41f8-9025-a350ca6b2a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d620f23a-729a-41f8-9025-a350ca6b2a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca90ac7-96f0-4a51-96e7-ffaa321619f1', 'volume_name': 'volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c118276-ed98-4ca0-9588-992f8d59757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c118276-ed98-4ca0-9588-992f8d59757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c146781f-ba2d-40b5-ac95-036b52835073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:56 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Volume 0ca90ac7-96f0-4a51-96e7-ffaa321619f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1', 'volume_size': 1} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2044308821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca90ac7-96f0-4a51-96e7-ffaa321619f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0686dd2431024e57a749b3b30fa962ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:56Z,use_quota=True,user_id='f887e9e00bd54e81ad8c7a382c280876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Creating volume 0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:56 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:56 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 1073741824 Sep 28 15:04:56 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:56 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 1073741824" returned: 0 in 0.607s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:56 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:04:56 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:57 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 0.309s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c146781f-ba2d-40b5-ac95-036b52835073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255c56b8-dbf0-4d08-9975-d0d3d71b5543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Volume volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 (0ca90ac7-96f0-4a51-96e7-ffaa321619f1): created successfully Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255c56b8-dbf0-4d08-9975-d0d3d71b5543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Flow 'volume_create_manager' (50960a41-a050-4163-9f01-dcc85c4015b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9d4ff836-d5f4-413d-bbd6-dba3f7944d1c tempest-VolumesActionsTest-1969565267 None] Created volume successfully. Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Flow 'volume_create_manager' (ed619a44-b8bd-45b0-956c-0e439d55e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19faf5c8-da57-4e08-97e5-e32d84da4569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19faf5c8-da57-4e08-97e5-e32d84da4569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-900689628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605af1b9-9357-42d7-a5a3-4a2cbc5e6a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb4633e81be40a9b54e09a15ff31903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:58Z,use_quota=True,user_id='3f5d2cdfa3f2438eb95169b1df3d1dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed6b00e-e1f8-4639-b757-a8767378cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed6b00e-e1f8-4639-b757-a8767378cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847a330d-f25e-49f9-ae5d-ba37bfd4baeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847a330d-f25e-49f9-ae5d-ba37bfd4baeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605af1b9-9357-42d7-a5a3-4a2cbc5e6a05', 'volume_name': 'volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9937d794-71d6-4ac4-8731-d2ae7f4bf24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9937d794-71d6-4ac4-8731-d2ae7f4bf24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa7ef56-ac7d-4f62-8e4a-e91d4dae4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Volume 605af1b9-9357-42d7-a5a3-4a2cbc5e6a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05', 'volume_size': 1} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-900689628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605af1b9-9357-42d7-a5a3-4a2cbc5e6a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fb4633e81be40a9b54e09a15ff31903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:58Z,use_quota=True,user_id='3f5d2cdfa3f2438eb95169b1df3d1dab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Creating volume 605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:57 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:57 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 1073741824 Sep 28 15:04:57 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Flow 'volume_create_manager' (a206d33a-d4b9-47a1-9fb6-7082b0390a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8283ec-a5e6-4ec2-b510-4d309290a796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8283ec-a5e6-4ec2-b510-4d309290a796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-593558615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a953d33c-70e8-4fae-a715-84fff589ffbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7ea2d27122414dad14938f3de942b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:58Z,use_quota=True,user_id='d8ff7ef4a1ea4c4ca5405da68d0d1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda19908-3b7f-46fd-b6eb-957a5e846f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fda19908-3b7f-46fd-b6eb-957a5e846f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b22443a-005b-44fb-89da-b7de92a39ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b22443a-005b-44fb-89da-b7de92a39ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a953d33c-70e8-4fae-a715-84fff589ffbc', 'volume_name': 'volume-a953d33c-70e8-4fae-a715-84fff589ffbc', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab1242b-610f-471f-9115-337bb9b6e791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab1242b-610f-471f-9115-337bb9b6e791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b17c926-fc4e-486c-855c-3af367c0fe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Volume a953d33c-70e8-4fae-a715-84fff589ffbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a953d33c-70e8-4fae-a715-84fff589ffbc', 'volume_size': 1} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:58 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 1073741824" returned: 0 in 0.645s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:58 devstack sudo[91753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 Sep 28 15:04:58 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:58 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05" returned: 0 in 0.442s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-593558615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a953d33c-70e8-4fae-a715-84fff589ffbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7ea2d27122414dad14938f3de942b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:04:58Z,use_quota=True,user_id='d8ff7ef4a1ea4c4ca5405da68d0d1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Creating volume a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:04:58 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:04:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:58 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc 1073741824 Sep 28 15:04:58 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:04:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa7ef56-ac7d-4f62-8e4a-e91d4dae4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918e9930-f7b9-40a1-83d3-dbf498bf4861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:04:59 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Volume volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 (605af1b9-9357-42d7-a5a3-4a2cbc5e6a05): created successfully Sep 28 15:04:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (918e9930-f7b9-40a1-83d3-dbf498bf4861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:04:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Flow 'volume_create_manager' (ed619a44-b8bd-45b0-956c-0e439d55e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:04:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-13db0530-2957-4cc7-acb4-016e041fa649 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Created volume successfully. Sep 28 15:04:59 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 28 15:04:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc 1073741824" returned: 0 in 0.668s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:04:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:04:59 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc Sep 28 15:04:59 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:00 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc" returned: 0 in 0.367s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b17c926-fc4e-486c-855c-3af367c0fe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a953d33c-70e8-4fae-a715-84fff589ffbc', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d5a7d6-3088-4d56-8f57-2d9691322f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Volume volume-a953d33c-70e8-4fae-a715-84fff589ffbc (a953d33c-70e8-4fae-a715-84fff589ffbc): created successfully Sep 28 15:05:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d5a7d6-3088-4d56-8f57-2d9691322f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Flow 'volume_create_manager' (a206d33a-d4b9-47a1-9fb6-7082b0390a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-248fc05a-9ad0-479c-9fb4-4ca546b631a8 tempest-VolumesDeleteCascade-12715955 None] Created volume successfully. Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Acquiring lock "cinder-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "cinder-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Acquiring lock "cinder-quobyte-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "cinder-quobyte-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05" acquired by "delete_volume" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d43597-5507-41d0-a824-7daea0a88962]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Creating offline snapshot bea266c8-30dd-4fd0-bc2f-354726e4eba3 of volume a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:01 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 Sep 28 15:05:01 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e405c64-cf08-4eee-a0be-8c349c199a42]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:01 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc Sep 28 15:05:01 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:02 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05" returned: 0 in 0.655s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:02 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05 Sep 28 15:05:02 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:02 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc" returned: 0 in 0.621s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:02 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 1G Sep 28 15:05:02 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:02 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05" returned: 0 in 0.665s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "cinder-quobyte-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05" released by "delete_volume" :: held 1.405s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Created reservations ['13581cdf-6971-48cd-b5c7-749c0161f41a', '3b507eca-6f73-443e-be8a-e1454f1f3bba', 'c21b5e47-d9a3-4c27-ab6f-71455f1b882d', 'ba15de39-2eb1-4e89-a61f-b720bdb7c627'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:03 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:05:03 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:03 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 1G" returned: 0 in 1.087s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:03 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 Sep 28 15:05:03 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:03 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.483s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Deleted volume successfully. Sep 28 15:05:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-16e0feed-9c2d-402a-aeda-593702db4bc3 tempest-VolumeQuotasNegativeTestJSON-113768286 None] Lock "cinder-605af1b9-9357-42d7-a5a3-4a2cbc5e6a05-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:04 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3" returned: 0 in 0.558s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 is being set with open permissions: ugo+rw Sep 28 15:05:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:04 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 Sep 28 15:05:04 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:04 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3" returned: 0 in 0.521s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:04 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.info Sep 28 15:05:04 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:05 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.info" returned: 0 in 0.388s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:05 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.info is being set with open permissions: ugo+rw Sep 28 15:05:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:05 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.info Sep 28 15:05:05 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:05 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.info" returned: 0 in 0.404s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.761s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-57d63ef8-800f-49e3-9916-ddcad9b55268 tempest-VolumesDeleteCascade-12715955 None] Create snapshot completed successfully Sep 28 15:05:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Creating offline snapshot ee9ebffb-244b-4c97-a7c1-bfc695289f52 of volume a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa74b30-fc22-472b-b7fd-339139cd4af6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:06 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 Sep 28 15:05:06 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:07 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3" returned: 0 in 0.600s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a953d33c-70e8-4fae-a715-84fff589ffbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:07 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 1G Sep 28 15:05:07 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:08 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 1G" returned: 0 in 1.105s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:08 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 Sep 28 15:05:08 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:09 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52" returned: 0 in 0.896s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:09 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 is being set with open permissions: ugo+rw Sep 28 15:05:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:09 devstack sudo[91914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 Sep 28 15:05:09 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:09 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52" returned: 0 in 0.454s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c3d64841-cdbb-4ec4-af44-c9252a780496 tempest-VolumesDeleteCascade-12715955 None] Create snapshot completed successfully Sep 28 15:05:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-a953d33c-70e8-4fae-a715-84fff589ffbc-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-a953d33c-70e8-4fae-a715-84fff589ffbc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Performing cascade delete. {{(pid=86301) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-bea266c8-30dd-4fd0-bc2f-354726e4eba3-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6bffd89a-6bf3-4f08-86e8-7d74e0f28164 tempest-VolumesActionsTest-1969565267 None] Acquiring lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" by "attach_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-bea266c8-30dd-4fd0-bc2f-354726e4eba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6bffd89a-6bf3-4f08-86e8-7d74e0f28164 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" acquired by "attach_volume" :: waited 0.057s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-bea266c8-30dd-4fd0-bc2f-354726e4eba3" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-bea266c8-30dd-4fd0-bc2f-354726e4eba3" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Deleting offline snapshot bea266c8-30dd-4fd0-bc2f-354726e4eba3 of volume a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] snapshot_file for this snap is: volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1336c8ce-79ba-4113-b7c6-cff5bbb906bf]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6bffd89a-6bf3-4f08-86e8-7d74e0f28164 tempest-VolumesActionsTest-1969565267 None] Attaching volume 0ca90ac7-96f0-4a51-96e7-ffaa321619f1 to instance e8815c1e-e2b0-4d13-8f97-68dbc0c58c1f at mountpoint /dev/vdb on host None. Sep 28 15:05:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6bffd89a-6bf3-4f08-86e8-7d74e0f28164 tempest-VolumesActionsTest-1969565267 None] Attach volume completed successfully. Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6bffd89a-6bf3-4f08-86e8-7d74e0f28164 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" released by "attach_volume" :: held 0.362s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:11 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 Sep 28 15:05:11 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-671f01c4-f5f8-4369-a4ea-eec810e848bf tempest-VolumesActionsTest-1969565267 None] Acquiring lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-detach_volume" by "detach_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-671f01c4-f5f8-4369-a4ea-eec810e848bf tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-671f01c4-f5f8-4369-a4ea-eec810e848bf tempest-VolumesActionsTest-1969565267 None] Detaching volume 0ca90ac7-96f0-4a51-96e7-ffaa321619f1 from instance e8815c1e-e2b0-4d13-8f97-68dbc0c58c1f. Sep 28 15:05:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-671f01c4-f5f8-4369-a4ea-eec810e848bf tempest-VolumesActionsTest-1969565267 None] Detach volume completed successfully. Sep 28 15:05:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-671f01c4-f5f8-4369-a4ea-eec810e848bf tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-detach_volume" released by "detach_volume" :: held 0.174s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:12 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3" returned: 0 in 0.744s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a953d33c-70e8-4fae-a715-84fff589ffbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:12 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a28ce0-0621-4d36-ba1a-cfb824bc9852]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:12 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc Sep 28 15:05:12 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:13 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc" returned: 0 in 0.909s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:13 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb3340-f2d4-402a-8550-bad330c25903]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:13 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 Sep 28 15:05:13 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:13 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52" returned: 0 in 0.566s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a953d33c-70e8-4fae-a715-84fff589ffbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:13 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f2bbd8-cd16-475e-84a5-18e429b0ae25]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:13 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 Sep 28 15:05:13 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:14 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3" returned: 0 in 0.587s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a953d33c-70e8-4fae-a715-84fff589ffbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b1f25-cbe9-46a5-8a8e-b24117090aa0]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:14 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc Sep 28 15:05:14 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:15 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc" returned: 0 in 0.598s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:15 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 Sep 28 15:05:15 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:15 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3" returned: 0 in 0.573s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:15 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3 Sep 28 15:05:15 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:16 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.bea266c8-30dd-4fd0-bc2f-354726e4eba3" returned: 0 in 0.515s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 -F qcow2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:16 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 -F qcow2 Sep 28 15:05:16 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:16 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a953d33c-70e8-4fae-a715-84fff589ffbc /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 -F qcow2" returned: 0 in 0.429s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-bea266c8-30dd-4fd0-bc2f-354726e4eba3" released by "_delete_snapshot" :: held 5.392s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" released by "delete_snapshot" :: held 5.457s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Created reservations ['6c6553bc-798b-42b1-bd3f-e615a1296819', '3695f4b3-cda4-4b7f-817a-4fd5beb5d353', 'e26fe325-8c47-4f91-b0a2-11761ac32929', 'f9c96543-79fa-48f8-9523-530b8fdb05be'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Delete snapshot completed successfully. Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-bea266c8-30dd-4fd0-bc2f-354726e4eba3-delete_snapshot" released by "delete_snapshot" :: held 5.831s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-ee9ebffb-244b-4c97-a7c1-bfc695289f52-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-ee9ebffb-244b-4c97-a7c1-bfc695289f52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-ee9ebffb-244b-4c97-a7c1-bfc695289f52" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-ee9ebffb-244b-4c97-a7c1-bfc695289f52" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Deleting offline snapshot ee9ebffb-244b-4c97-a7c1-bfc695289f52 of volume a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] snapshot_file for this snap is: volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db1029a-42aa-4f38-b32c-7c51a4df625e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 Sep 28 15:05:17 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Flow 'volume_create_manager' (30c46520-6977-4fcb-9fc5-9b29275944f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95196ff-646d-447d-9a6b-2aa663632c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95196ff-646d-447d-9a6b-2aa663632c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-32508242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f166b28-93d4-4ad7-b81e-d50296b82335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7d382a5a064791876959bc6047d0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:17Z,use_quota=True,user_id='501408d323cb48c9bd8a49d6aa345242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17c19a0-2c2f-456a-b7d8-af4b76d7e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e17c19a0-2c2f-456a-b7d8-af4b76d7e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62359b55-501c-4315-a208-c26bf3ab476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62359b55-501c-4315-a208-c26bf3ab476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f166b28-93d4-4ad7-b81e-d50296b82335', 'volume_name': 'volume-4f166b28-93d4-4ad7-b81e-d50296b82335', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bdbb79-a9aa-4bcc-a4ce-ea42e53410a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bdbb79-a9aa-4bcc-a4ce-ea42e53410a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d94c89f-90db-4d7c-826c-7ca947b8f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:17 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Volume 4f166b28-93d4-4ad7-b81e-d50296b82335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f166b28-93d4-4ad7-b81e-d50296b82335', 'volume_size': 1} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:17 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-32508242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f166b28-93d4-4ad7-b81e-d50296b82335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7d382a5a064791876959bc6047d0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:17Z,use_quota=True,user_id='501408d323cb48c9bd8a49d6aa345242',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Creating volume 4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:17 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52" returned: 0 in 0.652s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a953d33c-70e8-4fae-a715-84fff589ffbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:17 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 1073741824 Sep 28 15:05:17 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfc017b-da11-40c7-bec4-8c7b32ae2072]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:17 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc Sep 28 15:05:17 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:18 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 1073741824" returned: 0 in 0.709s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:18 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc" returned: 0 in 0.701s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:18 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 Sep 28 15:05:18 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:18 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 Sep 28 15:05:18 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:18 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335" returned: 0 in 0.453s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d94c89f-90db-4d7c-826c-7ca947b8f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f166b28-93d4-4ad7-b81e-d50296b82335', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e93c532-b404-4bbd-bb34-bbe1fa8522e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:19 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Volume volume-4f166b28-93d4-4ad7-b81e-d50296b82335 (4f166b28-93d4-4ad7-b81e-d50296b82335): created successfully Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e93c532-b404-4bbd-bb34-bbe1fa8522e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Flow 'volume_create_manager' (30c46520-6977-4fcb-9fc5-9b29275944f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dfe08b4a-96ee-4819-9889-9a53a8c76772 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Created volume successfully. Sep 28 15:05:19 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52" returned: 0 in 0.600s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:19 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52 Sep 28 15:05:19 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:19 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc.ee9ebffb-244b-4c97-a7c1-bfc695289f52" returned: 0 in 0.479s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-ee9ebffb-244b-4c97-a7c1-bfc695289f52" released by "_delete_snapshot" :: held 2.659s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" released by "delete_snapshot" :: held 2.695s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e79f9525-f1f6-4fcd-acd7-c267ca6f85ce req-d7e6a274-151d-468b-a60b-4c5eaf5b1c85 tempest-ServerActionsTestOtherA-1449271014 None] Terminate volume connection completed successfully. Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e79f9525-f1f6-4fcd-acd7-c267ca6f85ce req-d7e6a274-151d-468b-a60b-4c5eaf5b1c85 tempest-ServerActionsTestOtherA-1449271014 None] Deleting attachment ee251c45-52f3-465a-9ef7-80aa945b8b57. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Created reservations ['9279d73d-afcb-48fe-9387-95e077434cb8', '05ad87b3-d209-4cd5-a055-8fe17b6882c3', '809365cf-6941-404d-b07b-3e354f892a32', '5a526c75-702a-4b59-8111-4d0ee407904d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Delete snapshot completed successfully. Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-ee9ebffb-244b-4c97-a7c1-bfc695289f52-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Snapshots deleted, issuing volume delete {{(pid=86301) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd196c-de8f-4176-a13b-72a137fbed75]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Creating offline snapshot a8d34140-6c96-4517-9bf6-8ff771bd6648 of volume 4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b11283-e1db-4491-8007-aef8b02e8c2c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc Sep 28 15:05:20 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 Sep 28 15:05:20 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc" returned: 0 in 0.642s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc Sep 28 15:05:20 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:20 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335" returned: 0 in 0.700s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:20 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 1G Sep 28 15:05:20 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:21 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a953d33c-70e8-4fae-a715-84fff589ffbc" returned: 0 in 0.909s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-a953d33c-70e8-4fae-a715-84fff589ffbc" released by "delete_volume" :: held 1.726s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:21 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Created reservations ['e886ac90-870d-4fda-8c35-070d8d7ca5b6', '279d3988-85d8-4d3b-98b7-cbaf9e2d9f7d', '6e498926-c8f2-4a82-946f-93d49236823a', 'd1624da5-8bd3-4b79-a426-21d3d94ddb31'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:22 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 1G" returned: 0 in 1.246s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f166b28-93d4-4ad7-b81e-d50296b82335 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:22 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:05:22 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:22 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f166b28-93d4-4ad7-b81e-d50296b82335 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 Sep 28 15:05:22 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:22 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.575s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Deleted volume successfully. Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c8692ab4-2954-4a6d-9f1e-b7e4010b3b8e tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-a953d33c-70e8-4fae-a715-84fff589ffbc-delete_volume" released by "delete_volume" :: held 11.895s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:22 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f166b28-93d4-4ad7-b81e-d50296b82335 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648" returned: 0 in 0.763s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:22 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 is being set with open permissions: ugo+rw Sep 28 15:05:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:22 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 Sep 28 15:05:22 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:23 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648" returned: 0 in 0.493s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:23 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.info Sep 28 15:05:23 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:23 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.info" returned: 0 in 0.450s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:23 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.info is being set with open permissions: ugo+rw Sep 28 15:05:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:23 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.info Sep 28 15:05:23 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Flow 'volume_create_manager' (4977629a-6c60-43b3-b39e-03a70ae3372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c2b82-50e1-425b-bf8e-2d20c278a258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c2b82-50e1-425b-bf8e-2d20c278a258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1923312936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258b4548-3321-4a55-bc92-c84a366687d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7ea2d27122414dad14938f3de942b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:24Z,use_quota=True,user_id='d8ff7ef4a1ea4c4ca5405da68d0d1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0b354e-5c55-434f-b0ff-71ae1e6232f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0b354e-5c55-434f-b0ff-71ae1e6232f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf459b-7c7f-4603-b2ad-372fbf55f21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caf459b-7c7f-4603-b2ad-372fbf55f21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '258b4548-3321-4a55-bc92-c84a366687d5', 'volume_name': 'volume-258b4548-3321-4a55-bc92-c84a366687d5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cb7915-b842-49c5-a667-d655e586e214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56cb7915-b842-49c5-a667-d655e586e214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea68a3a-0fc4-440f-9a19-9638c2e5545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Volume 258b4548-3321-4a55-bc92-c84a366687d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-258b4548-3321-4a55-bc92-c84a366687d5', 'volume_size': 1} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:24 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.info" returned: 0 in 0.404s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.256s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1923312936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=258b4548-3321-4a55-bc92-c84a366687d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7ea2d27122414dad14938f3de942b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:24Z,use_quota=True,user_id='d8ff7ef4a1ea4c4ca5405da68d0d1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Creating volume 258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:24 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:05:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:24 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 1073741824 Sep 28 15:05:24 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6b1ff827-f287-49e1-8b97-6c1909b1b6b3 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Create snapshot completed successfully Sep 28 15:05:25 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 1073741824" returned: 0 in 0.796s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:25 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 Sep 28 15:05:25 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:25 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5" returned: 0 in 0.459s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea68a3a-0fc4-440f-9a19-9638c2e5545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-258b4548-3321-4a55-bc92-c84a366687d5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1df77c7-4090-4d73-9e25-1fc6ed37fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:25 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Volume volume-258b4548-3321-4a55-bc92-c84a366687d5 (258b4548-3321-4a55-bc92-c84a366687d5): created successfully Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1df77c7-4090-4d73-9e25-1fc6ed37fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Flow 'volume_create_manager' (4977629a-6c60-43b3-b39e-03a70ae3372b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f5cb2e42-7a94-460f-8ba9-4011fbc89d80 tempest-VolumesDeleteCascade-12715955 None] Created volume successfully. Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "cinder-a8d34140-6c96-4517-9bf6-8ff771bd6648-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-a8d34140-6c96-4517-9bf6-8ff771bd6648-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "cinder-quobyte-4f166b28-93d4-4ad7-b81e-d50296b82335" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-quobyte-4f166b28-93d4-4ad7-b81e-d50296b82335" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "cinder-quobyte-a8d34140-6c96-4517-9bf6-8ff771bd6648" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Creating offline snapshot 8e25c764-b606-41ab-8c32-dd51ae29727a of volume 258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-quobyte-a8d34140-6c96-4517-9bf6-8ff771bd6648" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Deleting offline snapshot a8d34140-6c96-4517-9bf6-8ff771bd6648 of volume 4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] snapshot_file for this snap is: volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec9685f-42ec-4704-998e-96b0ea34a626]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fd2587-579d-4834-9711-00bf6b00b372]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:26 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 Sep 28 15:05:26 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:26 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 Sep 28 15:05:26 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5" returned: 0 in 0.607s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:27 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a 1G Sep 28 15:05:27 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648" returned: 0 in 0.679s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f166b28-93d4-4ad7-b81e-d50296b82335(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b58aec-0426-485e-a37b-2b00ac9cf1a9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:27 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 Sep 28 15:05:27 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:27 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a 1G" returned: 0 in 0.796s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258b4548-3321-4a55-bc92-c84a366687d5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:28 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:28 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258b4548-3321-4a55-bc92-c84a366687d5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a Sep 28 15:05:28 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335" returned: 0 in 0.728s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:28 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 Sep 28 15:05:28 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:28 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-258b4548-3321-4a55-bc92-c84a366687d5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a" returned: 0 in 0.689s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:28 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a is being set with open permissions: ugo+rw Sep 28 15:05:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:28 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a Sep 28 15:05:28 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648" returned: 0 in 1.000s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:29 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648 Sep 28 15:05:29 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a" returned: 0 in 0.634s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=75,cinder:UPDATE=67,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=80,cinder:UPDATE=64,cinder:INSERT=21,cinder:DELETE=4 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:29 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.info Sep 28 15:05:29 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:29 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335.a8d34140-6c96-4517-9bf6-8ff771bd6648" returned: 0 in 0.806s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-quobyte-a8d34140-6c96-4517-9bf6-8ff771bd6648" released by "_delete_snapshot" :: held 3.469s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-quobyte-4f166b28-93d4-4ad7-b81e-d50296b82335" released by "delete_snapshot" :: held 3.548s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.info" returned: 0 in 0.660s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:30 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.info is being set with open permissions: ugo+rw Sep 28 15:05:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:30 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Created reservations ['c7e08eaa-6e5a-44b8-8a24-016b53cb19df', '6eb2a5e3-8a1a-4ecc-a580-a1733c5bdd6b', '0de3a51c-3b93-4103-8833-91d868b13eab', '0206b5eb-c81d-4fb5-9877-3c3a4917bf5e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:30 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.info Sep 28 15:05:30 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Delete snapshot completed successfully. Sep 28 15:05:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-918630c2-876f-4353-a0e5-1615ddd04a7a tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-a8d34140-6c96-4517-9bf6-8ff771bd6648-delete_snapshot" released by "delete_snapshot" :: held 3.999s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:30 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.info" returned: 0 in 0.717s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.469s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1b058dfd-32df-4ba0-9c6d-30f6c947268f tempest-VolumesDeleteCascade-12715955 None] Create snapshot completed successfully Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "cinder-4f166b28-93d4-4ad7-b81e-d50296b82335-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-4f166b28-93d4-4ad7-b81e-d50296b82335-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "cinder-quobyte-4f166b28-93d4-4ad7-b81e-d50296b82335" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-quobyte-4f166b28-93d4-4ad7-b81e-d50296b82335" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cd807a-ee65-4eaf-9abf-62a81f3f87d4]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:31 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 Sep 28 15:05:31 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Flow 'volume_create_manager' (388ef94f-49fc-47c2-b11a-6dadaaad8be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5b4fda-1549-4c19-9941-b27b829fed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5b4fda-1549-4c19-9941-b27b829fed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1716555612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e845ccca3a48368038f1c0a28c705b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:31Z,use_quota=True,user_id='5ca150efd76c4afab5297c46f2f166a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bda6f1-feef-4fa8-a17c-75ee141f9963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bda6f1-feef-4fa8-a17c-75ee141f9963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57565ac4-c4f6-4986-9a16-c627ef3bbf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:31 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:05:32 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335" returned: 0 in 0.795s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:32 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335 Sep 28 15:05:32 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57565ac4-c4f6-4986-9a16-c627ef3bbf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd85f433e-cb9a-4ecf-874b-bbe0e7dc70a3', 'volume_name': 'volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29db5ae1-7da2-47d0-ae30-9ca4a1d167fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29db5ae1-7da2-47d0-ae30-9ca4a1d167fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf50277-4ca4-4af6-a9b3-577ac150d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Volume d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Trying to clone d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61cf5c7-d118-4d25-9f80-4889c0b1cc3d tempest-VolumesActionsTest-1969565267 None] Acquiring lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" by "attach_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:32 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61cf5c7-d118-4d25-9f80-4889c0b1cc3d tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" acquired by "attach_volume" :: waited 0.055s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4f166b28-93d4-4ad7-b81e-d50296b82335" returned: 0 in 0.748s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-quobyte-4f166b28-93d4-4ad7-b81e-d50296b82335" released by "delete_volume" :: held 1.727s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d61cf5c7-d118-4d25-9f80-4889c0b1cc3d tempest-VolumesActionsTest-1969565267 None] Attaching volume 0ca90ac7-96f0-4a51-96e7-ffaa321619f1 to instance 58a3e1ec-6c48-4113-b769-b3134ecd392e at mountpoint /dev/vdb on host None. Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Created reservations ['bab794c4-7e68-4a44-a204-3a2dbbd4fa4a', 'ea04696c-df07-453d-89d8-f6a0ce81a807', '8dad6ed5-d473-4a7c-aaa5-28811a80e3d6', '20629f9f-71de-4ad8-b810-53c5e14e1c55'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d61cf5c7-d118-4d25-9f80-4889c0b1cc3d tempest-VolumesActionsTest-1969565267 None] Attach volume completed successfully. Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61cf5c7-d118-4d25-9f80-4889c0b1cc3d tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" released by "attach_volume" :: held 0.424s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:33 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:05:33 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:05:33 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Flow 'volume_create_manager' (50f5bbd2-6c85-4319-a374-f39e1a356998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704539b7-184a-4461-9c73-0e80a4aed8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536bc1f-952c-4b01-9202-aecc0d897e27]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704539b7-184a-4461-9c73-0e80a4aed8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1956945323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5040131d-9815-4b83-b8b3-976ee20400db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7ea2d27122414dad14938f3de942b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e25c764-b606-41ab-8c32-dd51ae29727a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:33Z,use_quota=True,user_id='d8ff7ef4a1ea4c4ca5405da68d0d1006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28eb8fc7-2c1e-4d3b-b25b-9099992a1857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28eb8fc7-2c1e-4d3b-b25b-9099992a1857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b461b602-ddd1-48bc-8ce5-755b2570ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b461b602-ddd1-48bc-8ce5-755b2570ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5040131d-9815-4b83-b8b3-976ee20400db', 'volume_name': 'volume-5040131d-9815-4b83-b8b3-976ee20400db', 'volume_size': 1, 'snapshot_id': '8e25c764-b606-41ab-8c32-dd51ae29727a'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8887ca9-7f71-401e-8d82-fc3f6a5e4445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:34 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8887ca9-7f71-401e-8d82-fc3f6a5e4445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f6715d-e2aa-48f0-8efb-8a3d5de6dfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:34 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Volume 5040131d-9815-4b83-b8b3-976ee20400db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5040131d-9815-4b83-b8b3-976ee20400db', 'volume_size': 1, 'snapshot_id': '8e25c764-b606-41ab-8c32-dd51ae29727a'} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78786c30-49f7-4bf7-b3aa-ac75966b2881 tempest-VolumesActionsTest-1969565267 None] Acquiring lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-detach_volume" by "detach_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.722s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-8e25c764-b606-41ab-8c32-dd51ae29727a-5040131d-9815-4b83-b8b3-976ee20400db" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:34 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD Sep 28 15:05:34 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Deleted volume successfully. Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78786c30-49f7-4bf7-b3aa-ac75966b2881 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-detach_volume" acquired by "detach_volume" :: waited 0.074s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-78786c30-49f7-4bf7-b3aa-ac75966b2881 tempest-VolumesActionsTest-1969565267 None] Detaching volume 0ca90ac7-96f0-4a51-96e7-ffaa321619f1 from instance 58a3e1ec-6c48-4113-b769-b3134ecd392e. Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-8e25c764-b606-41ab-8c32-dd51ae29727a-5040131d-9815-4b83-b8b3-976ee20400db" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Creating volume 5040131d-9815-4b83-b8b3-976ee20400db from snapshot 8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-5040131d-9815-4b83-b8b3-976ee20400db" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1572712-a1a9-4554-b643-d16fcd316c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-179927815 None] Lock "cinder-4f166b28-93d4-4ad7-b81e-d50296b82335-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-5040131d-9815-4b83-b8b3-976ee20400db" acquired by "_copy_volume_from_snapshot" :: waited 0.074s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] snapshot: 8e25c764-b606-41ab-8c32-dd51ae29727a, volume: 5040131d-9815-4b83-b8b3-976ee20400db, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-78786c30-49f7-4bf7-b3aa-ac75966b2881 tempest-VolumesActionsTest-1969565267 None] Detach volume completed successfully. Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78786c30-49f7-4bf7-b3aa-ac75966b2881 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-detach_volume" released by "detach_volume" :: held 0.265s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b5de2d-4733-4274-82bf-2c43f0885181]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:34 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c is fetched for user 5ca150efd76c4afab5297c46f2f166a6. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:05:34 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a Sep 28 15:05:34 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[47472595-04e6-4687-9cfc-5b3b63f13308]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:35 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD Sep 28 15:05:35 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:35 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a" returned: 0 in 0.869s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258b4548-3321-4a55-bc92-c84a366687d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[458e8611-de65-49c3-8536-d9841dbbccb0]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:35 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD" returned: 0 in 0.783s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:35 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 Sep 28 15:05:35 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:36 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5" returned: 0 in 0.841s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:05:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:05:36 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:05:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:36 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db Sep 28 15:05:36 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:44 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=25,cinder:UPDATE=16,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:44 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:05:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:46 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db" returned: 0 in 10.233s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5, size 1024.00 MB, duration 10.23 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:05:46 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Converted 1024.00 MB image at 100.06 MB/s Sep 28 15:05:46 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db is being set with open permissions: ugo+rw Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:46 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db Sep 28 15:05:46 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:46 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db" returned: 0 in 0.353s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-5040131d-9815-4b83-b8b3-976ee20400db" released by "_copy_volume_from_snapshot" :: held 12.514s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-8e25c764-b606-41ab-8c32-dd51ae29727a-5040131d-9815-4b83-b8b3-976ee20400db" released by "_create_volume_from_snapshot" :: held 12.670s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.740s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.326s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1716555612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e845ccca3a48368038f1c0a28c705b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:31Z,use_quota=True,user_id='5ca150efd76c4afab5297c46f2f166a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Creating volume d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:05:46 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:46 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 1073741824 Sep 28 15:05:46 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f6715d-e2aa-48f0-8efb-8a3d5de6dfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5040131d-9815-4b83-b8b3-976ee20400db', 'volume_size': 1, 'snapshot_id': '8e25c764-b606-41ab-8c32-dd51ae29727a'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a842720-5ff8-426f-94ac-4d95c041e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:46 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Volume volume-5040131d-9815-4b83-b8b3-976ee20400db (5040131d-9815-4b83-b8b3-976ee20400db): created successfully Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a842720-5ff8-426f-94ac-4d95c041e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Flow 'volume_create_manager' (50f5bbd2-6c85-4319-a374-f39e1a356998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:47 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6d479ed5-c0ce-4181-a029-8305f90a47cf tempest-VolumesDeleteCascade-12715955 None] Created volume successfully. Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:05:47 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:47 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 1073741824" returned: 0 in 0.636s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.465s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:47 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 Sep 28 15:05:47 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:05:47 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3" returned: 0 in 0.331s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.725s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e31254-36f2-47e0-8889-f01df6abf03e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:47 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Attempting download of 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[366577ee-f45d-449c-9864-74e4b823c861]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4ykp83o {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:05:48 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-258b4548-3321-4a55-bc92-c84a366687d5-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:48 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4ykp83o Sep 28 15:05:48 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-258b4548-3321-4a55-bc92-c84a366687d5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Performing cascade delete. {{(pid=86301) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-8e25c764-b606-41ab-8c32-dd51ae29727a-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-8e25c764-b606-41ab-8c32-dd51ae29727a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-258b4548-3321-4a55-bc92-c84a366687d5" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-258b4548-3321-4a55-bc92-c84a366687d5" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-8e25c764-b606-41ab-8c32-dd51ae29727a" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-8e25c764-b606-41ab-8c32-dd51ae29727a" acquired by "_delete_snapshot" :: waited 0.068s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Deleting offline snapshot 8e25c764-b606-41ab-8c32-dd51ae29727a of volume 258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] snapshot_file for this snap is: volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:05:48 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 0.715s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[112b84c7-24d9-49c5-a6db-6633143d214f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f5eccd-57bb-4d5f-a2f7-f3859869aeee]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4ykp83o" returned: 0 in 0.661s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4ykp83o {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:48 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a Sep 28 15:05:48 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:05:48 devstack sudo[92401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:05:48 devstack sudo[92401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Flow 'volume_create_manager' (786fa9ca-13d2-4ee9-9ce0-c37ab67dcc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf891bf-1b55-44fd-baf6-ff1a1238c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf891bf-1b55-44fd-baf6-ff1a1238c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-331186349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9ade27-fe4d-4eab-a120-7dc31c0b1214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d41d5eb4d4b10ab35e5ace6269320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:49Z,use_quota=True,user_id='4ff21c6152584c7e8031d83a8a709e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0287c1c9-a204-4dff-ad08-0889336badcf),volume_type_id=0287c1c9-a204-4dff-ad08-0889336badcf)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d4f9bb-1d06-4669-a0fd-ff0bf1ae03da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d4f9bb-1d06-4669-a0fd-ff0bf1ae03da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:48 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4ykp83o Sep 28 15:05:48 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f930884f-f735-4efd-9e29-809793b5c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f930884f-f735-4efd-9e29-809793b5c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9ade27-fe4d-4eab-a120-7dc31c0b1214', 'volume_name': 'volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec51461-c12b-4723-b506-c034c9fd99ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec51461-c12b-4723-b506-c034c9fd99ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce57b19-4116-49cf-8d25-69a0fcdd04cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:49 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Volume 3c9ade27-fe4d-4eab-a120-7dc31c0b1214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214', 'volume_size': 1} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:49 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a" returned: 0 in 0.501s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-258b4548-3321-4a55-bc92-c84a366687d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaa1662-2bf0-41e6-b5a2-2243132725e9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:49 devstack sudo[92401]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 0.589s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.bc552dd4-6a53-4d78-98cb-91640ccca164611hfohh.img {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:49 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.bc552dd4-6a53-4d78-98cb-91640ccca164611hfohh.img Sep 28 15:05:49 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:49 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4ykp83o" returned: 1 in 0.586s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4ykp83o' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab0e601-d68c-4661-8a49-7f339116410e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:49 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 Sep 28 15:05:49 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:49 devstack sudo[92418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD Sep 28 15:05:49 devstack sudo[92418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:49 devstack sudo[92418]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c was qcow2, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:05:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:50 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 Sep 28 15:05:50 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:50 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5" returned: 0 in 0.986s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:50 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a Sep 28 15:05:50 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:51 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a" returned: 0 in 0.917s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:51 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a Sep 28 15:05:51 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:51 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5.8e25c764-b606-41ab-8c32-dd51ae29727a" returned: 0 in 0.573s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-8e25c764-b606-41ab-8c32-dd51ae29727a" released by "_delete_snapshot" :: held 3.205s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-258b4548-3321-4a55-bc92-c84a366687d5" released by "delete_snapshot" :: held 3.291s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:52 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Created reservations ['08c22b48-ae57-43af-a500-cf4c63d2374a', '79d7154e-f537-4af0-84b8-c8963929d166', '2ce2bc23-ed69-44b2-8cd8-e795de45fce5', '37a39ee5-a882-479f-afeb-5a21e016227f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Delete snapshot completed successfully. Sep 28 15:05:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-8e25c764-b606-41ab-8c32-dd51ae29727a-delete_snapshot" released by "delete_snapshot" :: held 3.863s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Snapshots deleted, issuing volume delete {{(pid=86301) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 15:05:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-258b4548-3321-4a55-bc92-c84a366687d5" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-258b4548-3321-4a55-bc92-c84a366687d5" acquired by "delete_volume" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:52 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63097b5-4c19-4d0d-b642-3f012fd88e8e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:52 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 Sep 28 15:05:52 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5" returned: 0 in 0.720s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:53 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5 Sep 28 15:05:53 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:53 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-258b4548-3321-4a55-bc92-c84a366687d5" returned: 0 in 0.521s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-258b4548-3321-4a55-bc92-c84a366687d5" released by "delete_volume" :: held 1.444s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:53 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Created reservations ['9cdc87a1-b0a8-4500-aeee-89a8030f1b18', 'd187d0bb-b3cf-4359-85c7-feb85de950f9', 'b3b40508-ac65-4529-bf5d-20ed4496beb8', 'd4acbc74-2548-47d2-8ee4-7c22142187b3'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:54 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:05:54 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-5040131d-9815-4b83-b8b3-976ee20400db-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-5040131d-9815-4b83-b8b3-976ee20400db-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "cinder-quobyte-5040131d-9815-4b83-b8b3-976ee20400db" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:05:54 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-5040131d-9815-4b83-b8b3-976ee20400db" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.667s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Deleted volume successfully. Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e135a35c-8536-4a96-af67-ee09736267b5 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-258b4548-3321-4a55-bc92-c84a366687d5-delete_volume" released by "delete_volume" :: held 6.529s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[207dc96a-2c03-4f7a-9e18-6153d669d8ef]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:55 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db Sep 28 15:05:55 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:55 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db" returned: 0 in 1.043s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:55 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db Sep 28 15:05:55 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:56 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5040131d-9815-4b83-b8b3-976ee20400db" returned: 0 in 0.472s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-quobyte-5040131d-9815-4b83-b8b3-976ee20400db" released by "delete_volume" :: held 1.668s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Created reservations ['0fa7106a-9757-4638-a5cb-18fa2cd1466a', '422d63cb-77ce-40d8-b8e5-ad0c9ca68775', '8016a8e2-c958-45de-af0c-ba229ba1ffe8', '6db64369-1e35-4c05-a930-6b9967a7874a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:05:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:56 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:05:56 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:57 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3" returned: 0 in 7.332s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:57 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_w4dld7e6devstack@QuobyteHD, size 112.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:05:57 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Converted 112.00 MB image at 15.27 MB/s Sep 28 15:05:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:57 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 1G Sep 28 15:05:57 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:57 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.626s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:57 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:05:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Deleted volume successfully. Sep 28 15:05:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96ca0bc2-af50-4c79-885e-1c2c72782bf1 tempest-VolumesDeleteCascade-12715955 None] Lock "cinder-5040131d-9815-4b83-b8b3-976ee20400db-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:05:58 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 1G" returned: 0 in 1.123s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Downloaded image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c for user 5ca150efd76c4afab5297c46f2f166a6 is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Marking volume d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Copying metadata from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c to d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Creating volume glance metadata for volume d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 backed by image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf50277-4ca4-4af6-a9b3-577ac150d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f64157-5a9b-4333-ac44-945f48dfa5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:05:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Volume volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 (d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3): created successfully Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f64157-5a9b-4333-ac44-945f48dfa5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:05:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Flow 'volume_create_manager' (388ef94f-49fc-47c2-b11a-6dadaaad8be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:05:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e7fba3fb-4814-4246-8b55-9fafeaedaf2f tempest-ServerActionsTestOtherA-1449271014 None] Created volume successfully. Sep 28 15:05:59 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.bc552dd4-6a53-4d78-98cb-91640ccca164611hfohh.img" returned: 0 in 9.837s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:59 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[13545309-0565-46fa-8088-37e5ff6b5fb2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:05:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:05:59 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:05:59 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:05:59 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 28 15:05:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 0.786s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:05:59 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1, size 1024.00 MB, duration 9.84 sec, destination /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.bc552dd4-6a53-4d78-98cb-91640ccca164611hfohh.img {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:05:59 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Converted 1024.00 MB image at 104.09 MB/s Sep 28 15:05:59 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] bc552dd4-6a53-4d78-98cb-91640ccca164 was raw, no need to convert to raw {{(pid=86301) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:06:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-b9db18d2-0c10-4663-8728-3e60354ecc82 req-4d4eeb1c-73ad-4f40-a2c2-1c6b4cdcdcab tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Flow 'volume_create_manager' (3372d20c-8df9-41da-a5cc-6dd8268679a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a6c6e0-ac0e-4e49-bc32-13eef9b78aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a6c6e0-ac0e-4e49-bc32-13eef9b78aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1615689140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972252a-0034-4deb-838a-8f1d32c87014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe3bb7ea90a4093b95f9b77f9e9eb8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:05Z,use_quota=True,user_id='bfbcd3463b1141329cbe4da105dc1940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336399f3-ceed-4c20-a3d4-90b74157a439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336399f3-ceed-4c20-a3d4-90b74157a439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142fedb7-3fe2-443a-8d8b-3edf49124495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142fedb7-3fe2-443a-8d8b-3edf49124495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b972252a-0034-4deb-838a-8f1d32c87014', 'volume_name': 'volume-b972252a-0034-4deb-838a-8f1d32c87014', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d30b1e-7fd0-41a8-927b-ed7499bab46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d30b1e-7fd0-41a8-927b-ed7499bab46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b85329-c4b6-4821-822a-9171ca0c49e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:05 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Volume b972252a-0034-4deb-838a-8f1d32c87014: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b972252a-0034-4deb-838a-8f1d32c87014', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:06:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Trying to clone b972252a-0034-4deb-838a-8f1d32c87014 from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:06:06 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:06:06 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:06:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb1136-855b-4a0c-b446-53b027082262]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:06 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD Sep 28 15:06:06 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:06 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:06 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c is fetched for user bfbcd3463b1141329cbe4da105dc1940. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:06:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2533a41d-0b28-477b-946e-eb8e810567ac]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:07 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD Sep 28 15:06:07 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:07 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:16 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:16 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=26,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=17 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.052s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Uploaded volume to glance image-id: bc552dd4-6a53-4d78-98cb-91640ccca164. {{(pid=86301) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 34.965s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-331186349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9ade27-fe4d-4eab-a120-7dc31c0b1214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f4d41d5eb4d4b10ab35e5ace6269320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:05:49Z,use_quota=True,user_id='4ff21c6152584c7e8031d83a8a709e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0287c1c9-a204-4dff-ad08-0889336badcf),volume_type_id=0287c1c9-a204-4dff-ad08-0889336badcf)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Creating volume 3c9ade27-fe4d-4eab-a120-7dc31c0b1214 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:06:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:24 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 1073741824 Sep 28 15:06:24 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dd94e449-73cd-4d92-a5c4-cf59b474fcd7 tempest-VolumesActionsTest-1969565267 None] Copy volume to image completed successfully. Sep 28 15:06:24 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 1073741824" returned: 0 in 0.664s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:24 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 Sep 28 15:06:24 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:25 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214" returned: 0 in 0.380s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-b9db18d2-0c10-4663-8728-3e60354ecc82 req-4d4eeb1c-73ad-4f40-a2c2-1c6b4cdcdcab tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.937s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce57b19-4116-49cf-8d25-69a0fcdd04cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c3d54-6af0-4c6b-942c-cb35f419e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-b9db18d2-0c10-4663-8728-3e60354ecc82 req-4d4eeb1c-73ad-4f40-a2c2-1c6b4cdcdcab tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.643s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1615689140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b972252a-0034-4deb-838a-8f1d32c87014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe3bb7ea90a4093b95f9b77f9e9eb8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:06:05Z,use_quota=True,user_id='bfbcd3463b1141329cbe4da105dc1940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Creating volume b972252a-0034-4deb-838a-8f1d32c87014 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:06:25 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:25 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Volume volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 (3c9ade27-fe4d-4eab-a120-7dc31c0b1214): created successfully Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c3d54-6af0-4c6b-942c-cb35f419e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:25 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 1073741824 Sep 28 15:06:25 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Flow 'volume_create_manager' (786fa9ca-13d2-4ee9-9ce0-c37ab67dcc40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-10de97f9-b2b0-446d-be85-4143cfd818ba tempest-VolumeTypesAccessTest-863371585 None] Created volume successfully. Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-b9db18d2-0c10-4663-8728-3e60354ecc82 req-4d4eeb1c-73ad-4f40-a2c2-1c6b4cdcdcab tempest-ServerActionsTestOtherA-1449271014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea3c17e6-9b16-48be-8400-d0e6d3a171d0', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:06:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-b9db18d2-0c10-4663-8728-3e60354ecc82 req-4d4eeb1c-73ad-4f40-a2c2-1c6b4cdcdcab tempest-ServerActionsTestOtherA-1449271014 None] attachment_update completed successfully. Sep 28 15:06:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Acquiring lock "cinder-3c9ade27-fe4d-4eab-a120-7dc31c0b1214-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Lock "cinder-3c9ade27-fe4d-4eab-a120-7dc31c0b1214-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Acquiring lock "cinder-quobyte-3c9ade27-fe4d-4eab-a120-7dc31c0b1214" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Lock "cinder-quobyte-3c9ade27-fe4d-4eab-a120-7dc31c0b1214" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:26 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 1073741824" returned: 0 in 1.119s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed465d9a-77dd-4d11-a5c8-c62c2be6870f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:26 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 Sep 28 15:06:26 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:26 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 Sep 28 15:06:26 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:26 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014" returned: 0 in 0.594s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:06:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c8253f-cdaa-4565-a6d7-8e553f709fc4]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Attempting download of 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume b972252a-0034-4deb-838a-8f1d32c87014. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:06:27 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214" returned: 0 in 0.972s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3af0af9-546d-41e3-8d52-8171b6011f5d]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_8sm0d34l {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:27 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214 Sep 28 15:06:27 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:27 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:06:27 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:27 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_8sm0d34l Sep 28 15:06:27 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:27 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c9ade27-fe4d-4eab-a120-7dc31c0b1214" returned: 0 in 0.648s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Lock "cinder-quobyte-3c9ade27-fe4d-4eab-a120-7dc31c0b1214" released by "delete_volume" :: held 1.745s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:28 devstack cinder-volume[86301]: WARNING cinder.quota [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1453808470 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1453808470, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:28 devstack cinder-volume[86301]: WARNING cinder.quota [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1453808470 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1453808470, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Created reservations ['4846039c-3404-4bd6-8e30-4e228fd3d2d7', '29dde462-6960-4714-999c-65576df116ec', '37285f17-4dda-4340-a67e-a7eda68adf52', '359c9c08-3920-429d-88b1-e9339a537b80'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:28 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_8sm0d34l" returned: 0 in 0.817s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_8sm0d34l {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:28 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 1.178s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb59c45-271a-4079-9ae6-93b4ebb468b8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:28 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_8sm0d34l Sep 28 15:06:28 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:28 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:06:28 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:28 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_8sm0d34l" returned: 1 in 0.681s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_8sm0d34l' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4606e788-4d30-4164-b5f5-a0f07277a7e8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:28 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 0.693s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img Sep 28 15:06:29 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:06:29 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD Sep 28 15:06:29 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:29 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:29 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD" returned: 0 in 0.962s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c was qcow2, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:06:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:29 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 Sep 28 15:06:29 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:30 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 1.038s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:30 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Deleted volume successfully. Sep 28 15:06:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02a7d6d7-482e-4e7a-9896-0af346066a40 tempest-VolumeTypesAccessTest-863371585 None] Lock "cinder-3c9ade27-fe4d-4eab-a120-7dc31c0b1214-delete_volume" released by "delete_volume" :: held 4.352s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:40 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=17,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:06:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014" returned: 0 in 12.205s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:42 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_cyso6pr2devstack@QuobyteHD, size 112.00 MB, duration 12.21 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:42 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Converted 112.00 MB image at 9.18 MB/s Sep 28 15:06:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:42 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 1G Sep 28 15:06:42 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:43 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 1G" returned: 0 in 1.631s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:43 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Downloaded image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume b972252a-0034-4deb-838a-8f1d32c87014 successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:06:43 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c for user bfbcd3463b1141329cbe4da105dc1940 is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:06:43 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Marking volume b972252a-0034-4deb-838a-8f1d32c87014 as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:06:43 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Copying metadata from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c to b972252a-0034-4deb-838a-8f1d32c87014. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:06:43 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Creating volume glance metadata for volume b972252a-0034-4deb-838a-8f1d32c87014 backed by image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:06:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71b85329-c4b6-4821-822a-9171ca0c49e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b972252a-0034-4deb-838a-8f1d32c87014', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48d4703-e818-4357-9d92-9a7e6732e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:06:44 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Volume volume-b972252a-0034-4deb-838a-8f1d32c87014 (b972252a-0034-4deb-838a-8f1d32c87014): created successfully Sep 28 15:06:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48d4703-e818-4357-9d92-9a7e6732e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:06:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Flow 'volume_create_manager' (3372d20c-8df9-41da-a5cc-6dd8268679a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:06:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6562df96-272f-48ca-8e9b-cff15d3e70e6 tempest-VolumesExtendTest-1442577310 None] Created volume successfully. Sep 28 15:06:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:47 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img" returned: 0 in 18.053s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[863885d5-d236-4ee2-a43d-b37326fb933e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:47 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:06:47 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:47 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:06:47 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:47 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.588s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:06:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:06:48 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 1.316s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:48 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1, size 1024.00 MB, duration 18.05 sec, destination /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:48 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Converted 1024.00 MB image at 56.72 MB/s Sep 28 15:06:48 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] fec98ba9-1bb7-4c61-a467-0043438eb60c was raw, converting to qcow2 {{(pid=86301) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 15:06:48 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[922748c2-84fe-4e3f-9f4f-0e19ad2af18d]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:48 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img Sep 28 15:06:48 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:49 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img" returned: 0 in 1.036s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:49 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img Sep 28 15:06:49 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:50 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img" returned: 1 in 0.575s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:06:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img /opt/stack/data/cinder/conversion/vol_upload_awp63hhx {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:50 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img /opt/stack/data/cinder/conversion/vol_upload_awp63hhx Sep 28 15:06:50 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:50 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img /opt/stack/data/cinder/conversion/vol_upload_awp63hhx" returned: 0 in 0.564s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:50 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Image conversion details: src /opt/stack/data/cinder/conversion/0ca90ac7-96f0-4a51-96e7-ffaa321619f1.temp_image.fec98ba9-1bb7-4c61-a467-0043438eb60czo4jjm8c.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_awp63hhx {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:06:50 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 15:06:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c2f09-4de4-42b4-b0a9-7656ec50c87b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_awp63hhx {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:50 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_awp63hhx Sep 28 15:06:50 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:51 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_awp63hhx" returned: 0 in 0.941s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.608s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Uploaded volume to glance image-id: fec98ba9-1bb7-4c61-a467-0043438eb60c. {{(pid=86301) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:06:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 8.819s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e0da3b-e181-480b-a3c9-bb6c754c1bd3]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-11aa78dd-54d5-459f-824b-ea1b48d6de9c tempest-VolumesActionsTest-1969565267 None] Copy volume to image completed successfully. Sep 28 15:06:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:54 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 Sep 28 15:06:54 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:55 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014" returned: 0 in 0.647s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 2G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 2G" returned: 0 in 0.304s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-885db776-d6a9-456a-969c-f4d4b606ecd0 tempest-VolumesExtendTest-1442577310 None] Extend volume completed successfully. Sep 28 15:06:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-37be35ed-7df4-4a0f-b505-766fadef73a1 req-a904c399-72d7-4790-ac6d-ee0bff2f0945 tempest-ServerActionsTestOtherA-1449271014 None] Terminate volume connection completed successfully. Sep 28 15:06:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-37be35ed-7df4-4a0f-b505-766fadef73a1 req-a904c399-72d7-4790-ac6d-ee0bff2f0945 tempest-ServerActionsTestOtherA-1449271014 None] Deleting attachment ea3c17e6-9b16-48be-8400-d0e6d3a171d0. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:06:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "cinder-b972252a-0034-4deb-838a-8f1d32c87014-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Acquiring lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-b972252a-0034-4deb-838a-8f1d32c87014-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "cinder-quobyte-b972252a-0034-4deb-838a-8f1d32c87014" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Acquiring lock "cinder-quobyte-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-b972252a-0034-4deb-838a-8f1d32c87014" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-quobyte-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" acquired by "delete_volume" :: waited 0.068s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d86d4d-9f9d-4d30-8400-c5e8a133dda9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0ef798-2dc0-40df-9e70-424b63a650f7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:06:57 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 Sep 28 15:06:57 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 0.643s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1 Sep 28 15:06:57 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:57 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014" returned: 0 in 0.765s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:57 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014 Sep 28 15:06:57 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" returned: 0 in 0.464s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b972252a-0034-4deb-838a-8f1d32c87014" returned: 0 in 0.400s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-quobyte-0ca90ac7-96f0-4a51-96e7-ffaa321619f1" released by "delete_volume" :: held 1.214s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-b972252a-0034-4deb-838a-8f1d32c87014" released by "delete_volume" :: held 1.299s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Created reservations ['30441b03-4a4c-44b1-8a9c-91def4abcbc9', '7332d667-9905-40b9-ba43-22f680861fe7', 'c79a07e0-f260-4dd3-a266-61551c56618c', '55a6b27f-5eba-42db-96a3-3f3c587766ac'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Created reservations ['170bb785-eb2c-4536-a010-dc99d12aaeae', 'b9edabba-d40b-4696-aa62-37ecc9951c03', '36dfd45e-aaab-4e49-a465-e68949646bc6', '4ce43d8f-59af-47c8-8d2a-7eea62555f56'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:06:58 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:06:58 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:06:58 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-37be35ed-7df4-4a0f-b505-766fadef73a1 req-b3772241-a5ab-4317-b57a-13e13e85c54d tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-37be35ed-7df4-4a0f-b505-766fadef73a1 req-b3772241-a5ab-4317-b57a-13e13e85c54d tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-37be35ed-7df4-4a0f-b505-766fadef73a1 req-b3772241-a5ab-4317-b57a-13e13e85c54d tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:06:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-37be35ed-7df4-4a0f-b505-766fadef73a1 req-b3772241-a5ab-4317-b57a-13e13e85c54d tempest-ServerActionsTestOtherA-1449271014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '622801e8-7e52-4d33-ada8-333f98b716e2', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:06:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-37be35ed-7df4-4a0f-b505-766fadef73a1 req-b3772241-a5ab-4317-b57a-13e13e85c54d tempest-ServerActionsTestOtherA-1449271014 None] attachment_update completed successfully. Sep 28 15:06:59 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.538s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:59 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Deleted volume successfully. Sep 28 15:06:59 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Sep 28 15:06:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.476s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:06:59 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:06:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Deleted volume successfully. Sep 28 15:06:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e1fd7e30-3fb5-46e4-ab01-fdb20b609b56 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-b972252a-0034-4deb-838a-8f1d32c87014-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:06:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e8555d9f-da58-4822-af9f-67bd1baac2a3 tempest-VolumesActionsTest-1969565267 None] Lock "cinder-0ca90ac7-96f0-4a51-96e7-ffaa321619f1-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Flow 'volume_create_manager' (784b942a-a3f4-4417-a523-472ee5d8f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c2645-aa78-4873-a0ca-3de6ea0d6f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539c2645-aa78-4873-a0ca-3de6ea0d6f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1463988954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f86aa3-ab8f-4a8c-ae47-77c95e20854b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe3bb7ea90a4093b95f9b77f9e9eb8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:00Z,use_quota=True,user_id='bfbcd3463b1141329cbe4da105dc1940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7b178c-ea53-408b-a6a8-ebc3efef28c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7b178c-ea53-408b-a6a8-ebc3efef28c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58536479-8f90-4e18-958a-2f446a504068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58536479-8f90-4e18-958a-2f446a504068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f86aa3-ab8f-4a8c-ae47-77c95e20854b', 'volume_name': 'volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a61300-017f-4130-b5a0-71e6aee04c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a61300-017f-4130-b5a0-71e6aee04c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4c94fd-10bc-4a1f-b559-60aabce77fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Volume 30f86aa3-ab8f-4a8c-ae47-77c95e20854b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b', 'volume_size': 1} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1463988954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f86aa3-ab8f-4a8c-ae47-77c95e20854b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fe3bb7ea90a4093b95f9b77f9e9eb8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:00Z,use_quota=True,user_id='bfbcd3463b1141329cbe4da105dc1940',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Creating volume 30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:00 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:07:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:00 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b 1073741824 Sep 28 15:07:00 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:01 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b 1073741824" returned: 0 in 0.956s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:01 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b Sep 28 15:07:01 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:02 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" returned: 0 in 0.450s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4c94fd-10bc-4a1f-b559-60aabce77fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29660e4-daa3-4871-8b87-36c793f34e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Volume volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b (30f86aa3-ab8f-4a8c-ae47-77c95e20854b): created successfully Sep 28 15:07:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29660e4-daa3-4871-8b87-36c793f34e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Flow 'volume_create_manager' (784b942a-a3f4-4417-a523-472ee5d8f317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1f9feb16-9d06-4633-a71b-d1e89240ac43 tempest-VolumesExtendTest-1442577310 None] Created volume successfully. Sep 28 15:07:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Creating offline snapshot 5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 of volume 30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a7d59b-36bd-411a-9b5b-bf637ff83619]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:03 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b Sep 28 15:07:03 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:04 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" returned: 0 in 0.779s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:04 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 1G Sep 28 15:07:04 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:05 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 1G" returned: 0 in 1.291s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:05 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 Sep 28 15:07:05 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:06 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" returned: 0 in 0.726s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:06 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 is being set with open permissions: ugo+rw Sep 28 15:07:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:06 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 Sep 28 15:07:06 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:06 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" returned: 0 in 0.656s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:06 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.info Sep 28 15:07:06 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:07 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.info" returned: 0 in 0.453s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:07 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.info is being set with open permissions: ugo+rw Sep 28 15:07:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:07 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.info Sep 28 15:07:07 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:07 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.info" returned: 0 in 0.443s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.607s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:07 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7043562b-d666-4781-9f5f-c7bc93542204 tempest-VolumesExtendTest-1442577310 None] Create snapshot completed successfully Sep 28 15:07:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[233437d9-8afc-494e-b048-33793db8f56c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:09 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b Sep 28 15:07:09 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:09 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" returned: 0 in 0.848s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 2G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 2G" returned: 0 in 0.420s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.422s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d76d8a10-6672-41eb-956a-0e10d2df59ae tempest-VolumesExtendTest-1442577310 None] Extend volume completed successfully. Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "cinder-5f95930e-c4ad-4f1c-851c-c8dc43d6aae1-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-5f95930e-c4ad-4f1c-851c-c8dc43d6aae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "cinder-quobyte-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Acquiring lock "cinder-quobyte-5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Deleting offline snapshot 5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 of volume 30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] snapshot_file for this snap is: volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ce5d5e-b8c8-4a07-8a85-a284d177accb]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:11 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 Sep 28 15:07:11 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:12 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" returned: 0 in 0.585s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:12 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8637bf1b-e5a3-4647-8a0e-8e53675ca2dc]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:12 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b Sep 28 15:07:12 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:13 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" returned: 0 in 0.650s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:13 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 Sep 28 15:07:13 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:13 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" returned: 0 in 0.556s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:13 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1 Sep 28 15:07:13 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:14 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b.5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" returned: 0 in 0.652s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-5f95930e-c4ad-4f1c-851c-c8dc43d6aae1" released by "_delete_snapshot" :: held 2.627s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" released by "delete_snapshot" :: held 2.680s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:14 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Created reservations ['539612b8-3c90-4c2f-8b95-f5b5cf1ac6a9', 'c164455b-a276-4ec4-bb53-1d71f2aab78b', '30fca5f3-0a64-4e99-9f1d-459260c18902', 'b86a4d3a-32f3-465b-a8e6-423ebd9fa78f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Delete snapshot completed successfully. Sep 28 15:07:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e4faa325-3849-4c60-956e-d6a0ed988f46 tempest-VolumesExtendTest-1442577310 None] Lock "cinder-5f95930e-c4ad-4f1c-851c-c8dc43d6aae1-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Acquiring lock "cinder-30f86aa3-ab8f-4a8c-ae47-77c95e20854b-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Lock "cinder-30f86aa3-ab8f-4a8c-ae47-77c95e20854b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Acquiring lock "cinder-quobyte-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" acquired by "delete_volume" :: waited 0.040s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:15 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4699060-bf40-4789-a048-b1c07d8e4f79]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:15 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b Sep 28 15:07:15 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" returned: 0 in 0.648s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b Sep 28 15:07:16 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:16 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Flow 'volume_create_manager' (37d869cb-17c9-4399-b0ae-28d8392d9181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c887f3-2948-4b0e-9443-044e3b2c9c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" returned: 0 in 0.517s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c887f3-2948-4b0e-9443-044e3b2c9c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1946698410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823f5d9b-7767-43a3-9bd7-fe385d8dc853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35a82ca2a324fe8bf16492c9848a9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:16Z,use_quota=True,user_id='34804401443d4bccb7a9678cc2b1929a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8053bcb1-76c0-417c-b271-5963fd295c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8053bcb1-76c0-417c-b271-5963fd295c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b72a6aa-33eb-4aa4-bbd1-7358d83fa771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b72a6aa-33eb-4aa4-bbd1-7358d83fa771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '823f5d9b-7767-43a3-9bd7-fe385d8dc853', 'volume_name': 'volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3cbb89-2ec7-4d3d-af8f-a3f93c8ec718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3cbb89-2ec7-4d3d-af8f-a3f93c8ec718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66ecf1e-b5ff-4662-8221-fd1806124114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:16 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Volume 823f5d9b-7767-43a3-9bd7-fe385d8dc853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853', 'volume_size': 1} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1946698410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=823f5d9b-7767-43a3-9bd7-fe385d8dc853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35a82ca2a324fe8bf16492c9848a9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:16Z,use_quota=True,user_id='34804401443d4bccb7a9678cc2b1929a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Creating volume 823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:16 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Lock "cinder-quobyte-30f86aa3-ab8f-4a8c-ae47-77c95e20854b" released by "delete_volume" :: held 1.425s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:16 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 1073741824 Sep 28 15:07:16 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Created reservations ['daec3ac8-eac8-42de-9060-1c106b4a692b', '30f45c58-6d63-4205-a0a1-b80f8c09ad81', '40e81586-5349-4349-92d3-d6c2546c0759', '6227c79a-6154-45d3-94d0-920e57ddd021'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:16 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=50,cinder:INSERT=21,cinder:UPDATE=57,cinder:DELETE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:17 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:17 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:17 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.426s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:17 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Deleted volume successfully. Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-00632e46-7526-4ff7-9ab5-35bbd13f4bdd tempest-VolumesExtendTest-1442577310 None] Lock "cinder-30f86aa3-ab8f-4a8c-ae47-77c95e20854b-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:17 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 1073741824" returned: 0 in 0.928s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:17 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 Sep 28 15:07:17 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:18 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853" returned: 0 in 0.540s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66ecf1e-b5ff-4662-8221-fd1806124114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c513b3-6f80-4b34-b8c0-6c17aa3c2d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:18 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Volume volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 (823f5d9b-7767-43a3-9bd7-fe385d8dc853): created successfully Sep 28 15:07:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c513b3-6f80-4b34-b8c0-6c17aa3c2d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Flow 'volume_create_manager' (37d869cb-17c9-4399-b0ae-28d8392d9181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:18 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f1bea9a8-697f-453e-b5f8-307533d0c167 tempest-VolumesCloneTest-591852968 None] Created volume successfully. Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Flow 'volume_create_manager' (3bcabe30-23b7-4248-900c-2bca0ebf9c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6de2368-7b6f-4c51-bfaf-04ee10c02a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6de2368-7b6f-4c51-bfaf-04ee10c02a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-447385372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c500c82b-15ae-4b60-908b-ac3ee8ec704f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b35a82ca2a324fe8bf16492c9848a9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=823f5d9b-7767-43a3-9bd7-fe385d8dc853,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:20Z,use_quota=True,user_id='34804401443d4bccb7a9678cc2b1929a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a093ccd-d7b7-4078-9c93-0f9bf6429917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a093ccd-d7b7-4078-9c93-0f9bf6429917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91df205d-573c-4500-b1a0-a98ad09c2d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91df205d-573c-4500-b1a0-a98ad09c2d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c500c82b-15ae-4b60-908b-ac3ee8ec704f', 'volume_name': 'volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f', 'volume_size': 2, 'source_volid': '823f5d9b-7767-43a3-9bd7-fe385d8dc853', 'source_volstatus': 'available'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df1ca2d-4da2-46f4-9be5-34740f540003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df1ca2d-4da2-46f4-9be5-34740f540003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc85bae-eae2-414a-80fb-a64049184d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:20 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Volume c500c82b-15ae-4b60-908b-ac3ee8ec704f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f', 'volume_size': 2, 'source_volid': '823f5d9b-7767-43a3-9bd7-fe385d8dc853', 'source_volstatus': 'available'} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:20 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Cloning volume 823f5d9b-7767-43a3-9bd7-fe385d8dc853 to volume c500c82b-15ae-4b60-908b-ac3ee8ec704f Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Creating offline snapshot 15bbe75c-44cb-470c-8320-ccef86201351 of volume 823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379fc64-4c14-40c6-8208-bd65bc102d93]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:20 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 Sep 28 15:07:20 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:21 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853" returned: 0 in 0.890s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:21 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 1G Sep 28 15:07:21 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:22 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 1G" returned: 0 in 1.127s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:22 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 Sep 28 15:07:22 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:23 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351" returned: 0 in 0.814s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:23 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 is being set with open permissions: ugo+rw Sep 28 15:07:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:23 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 Sep 28 15:07:23 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:23 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351" returned: 0 in 0.525s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:23 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.info Sep 28 15:07:23 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:24 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.info" returned: 0 in 0.552s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:24 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.info is being set with open permissions: ugo+rw Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:24 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.info Sep 28 15:07:24 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:24 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.info" returned: 0 in 0.505s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Acquiring lock "cinder-quobyte-c500c82b-15ae-4b60-908b-ac3ee8ec704f" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-c500c82b-15ae-4b60-908b-ac3ee8ec704f" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] snapshot: 15bbe75c-44cb-470c-8320-ccef86201351, volume: c500c82b-15ae-4b60-908b-ac3ee8ec704f, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:25 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea82832-97dd-49b7-a535-007b63a5a8c0]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:25 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 Sep 28 15:07:25 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:25 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351" returned: 0 in 0.757s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:25 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d534f-4635-4f7d-9fc1-53f9d8a506e3]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:25 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 Sep 28 15:07:25 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:26 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Flow 'volume_create_manager' (6fa13ca4-e692-4e79-8f7a-cc062f610a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abdcdde-cf37-4f21-b6a2-b2bf3f5be603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853" returned: 0 in 0.627s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abdcdde-cf37-4f21-b6a2-b2bf3f5be603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420616522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e76eeeb-90ca-4350-9ed5-79b76f015f1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='672adadb47a346a791ae7cdd81c4532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:26Z,use_quota=True,user_id='5a0221ee399a4212bde420554b9b9bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:26 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f Sep 28 15:07:26 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9489b97-42ca-4dda-a970-df0c0383751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9489b97-42ca-4dda-a970-df0c0383751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33af6daf-7677-4bd0-a6ac-56447df07bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33af6daf-7677-4bd0-a6ac-56447df07bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e76eeeb-90ca-4350-9ed5-79b76f015f1f', 'volume_name': 'volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17c9d26-e428-4777-94c0-cf085206156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17c9d26-e428-4777-94c0-cf085206156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbcc6fa-b80e-4326-9660-159b26f657c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:26 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Volume 3e76eeeb-90ca-4350-9ed5-79b76f015f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f', 'volume_size': 1} Sep 28 15:07:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:36 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:36 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=56,cinder:INSERT=13,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:07:36 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f" returned: 0 in 10.257s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:36 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853, size 1024.00 MB, duration 10.26 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:07:36 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Converted 1024.00 MB image at 99.83 MB/s Sep 28 15:07:36 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f is being set with open permissions: ugo+rw Sep 28 15:07:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:36 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f Sep 28 15:07:36 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:37 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f" returned: 0 in 0.334s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-c500c82b-15ae-4b60-908b-ac3ee8ec704f" released by "_copy_volume_from_snapshot" :: held 12.085s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Acquiring lock "cinder-quobyte-15bbe75c-44cb-470c-8320-ccef86201351" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-15bbe75c-44cb-470c-8320-ccef86201351" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Deleting offline snapshot 15bbe75c-44cb-470c-8320-ccef86201351 of volume 823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] snapshot_file for this snap is: volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6032495-99b1-4190-9e5e-359f039c2212]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:37 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 Sep 28 15:07:37 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:37 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351" returned: 0 in 0.602s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5e6ce0-c260-4937-8311-c9e5feb528e1]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:38 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 Sep 28 15:07:38 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:38 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853" returned: 0 in 0.984s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:38 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 Sep 28 15:07:38 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:39 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351" returned: 0 in 0.628s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:39 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351 Sep 28 15:07:39 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:39 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853.15bbe75c-44cb-470c-8320-ccef86201351" returned: 0 in 0.532s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-15bbe75c-44cb-470c-8320-ccef86201351" released by "_delete_snapshot" :: held 2.956s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.813s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.607s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420616522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e76eeeb-90ca-4350-9ed5-79b76f015f1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='672adadb47a346a791ae7cdd81c4532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:26Z,use_quota=True,user_id='5a0221ee399a4212bde420554b9b9bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Creating volume 3e76eeeb-90ca-4350-9ed5-79b76f015f1f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:40 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:40 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f 1073741824 Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc85bae-eae2-414a-80fb-a64049184d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f', 'volume_size': 2, 'source_volid': '823f5d9b-7767-43a3-9bd7-fe385d8dc853', 'source_volstatus': 'available'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402f6125-4dac-4eb5-8986-00c840ea04e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:40 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Volume volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f (c500c82b-15ae-4b60-908b-ac3ee8ec704f): created successfully Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402f6125-4dac-4eb5-8986-00c840ea04e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Flow 'volume_create_manager' (3bcabe30-23b7-4248-900c-2bca0ebf9c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:40 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6e5928b4-e667-4717-9252-51e017ee8bff tempest-VolumesCloneTest-591852968 None] Created volume successfully. Sep 28 15:07:41 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f 1073741824" returned: 0 in 0.993s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Acquiring lock "cinder-c500c82b-15ae-4b60-908b-ac3ee8ec704f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:41 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f Sep 28 15:07:41 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Lock "cinder-c500c82b-15ae-4b60-908b-ac3ee8ec704f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-dc040ba3-0f00-4e75-b345-d194d3d59949 tempest-ServerActionsTestOtherA-1449271014 None] Terminate volume connection completed successfully. Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-dc040ba3-0f00-4e75-b345-d194d3d59949 tempest-ServerActionsTestOtherA-1449271014 None] Deleting attachment 622801e8-7e52-4d33-ada8-333f98b716e2. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Acquiring lock "cinder-quobyte-c500c82b-15ae-4b60-908b-ac3ee8ec704f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-c500c82b-15ae-4b60-908b-ac3ee8ec704f" acquired by "delete_volume" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ece359-c5ca-4fc1-a13e-47cf25d2fd7b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:41 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "cinder-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:41 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f" returned: 0 in 0.487s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:41 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbcc6fa-b80e-4326-9660-159b26f657c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15b1b3a-952c-42ec-8743-c9ca15940982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:41 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Volume volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f (3e76eeeb-90ca-4350-9ed5-79b76f015f1f): created successfully Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15b1b3a-952c-42ec-8743-c9ca15940982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Flow 'volume_create_manager' (6fa13ca4-e692-4e79-8f7a-cc062f610a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "cinder-quobyte-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2c016828-8ab5-4aea-a289-8473bb94eaf6 tempest-VolumesListTestJSON-1906886475 None] Created volume successfully. Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-quobyte-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f8abaf-feb7-46fa-a21c-4fd7e9f41e78]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:42 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 Sep 28 15:07:42 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:42 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f" returned: 0 in 0.780s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:42 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f Sep 28 15:07:42 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:42 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3" returned: 0 in 0.657s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:42 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3 Sep 28 15:07:42 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:42 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c500c82b-15ae-4b60-908b-ac3ee8ec704f" returned: 0 in 0.466s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-c500c82b-15ae-4b60-908b-ac3ee8ec704f" released by "delete_volume" :: held 1.333s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Created reservations ['a9f9fc3f-00c9-48f9-be09-3a78737b78c4', 'f6de9fe8-026e-4869-86f2-2234b948b067', '4f52f1e2-7f40-4b9b-9d81-738dea807832', 'fc702066-27f5-41ae-9659-72601322ec34'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:42 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3" returned: 0 in 0.326s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-quobyte-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3" released by "delete_volume" :: held 1.075s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.quota [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Created reservations ['18f7084d-40df-4668-a45c-956eb1338afc', '41bc24a4-03c8-4f7a-8f74-17036a9ab47f', '245f45fc-ae97-487a-90c2-2c6a861d3fec', '8a95357e-651f-49ad-a6cc-a4f3315f2c98'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:43 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:43 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:43 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:43 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:43 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.435s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.manager [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Deleted volume successfully. Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e6cd1ee4-8dcb-4026-bd5c-c52c00d83c14 req-4d341376-e193-4432-89d8-01d73208500e tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-d85f433e-cb9a-4ecf-874b-bbe0e7dc70a3-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:43 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.791s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Deleted volume successfully. Sep 28 15:07:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-777a84d4-df73-4f61-a91e-ed83b41a894a tempest-VolumesCloneTest-591852968 None] Lock "cinder-c500c82b-15ae-4b60-908b-ac3ee8ec704f-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Acquiring lock "cinder-823f5d9b-7767-43a3-9bd7-fe385d8dc853-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Lock "cinder-823f5d9b-7767-43a3-9bd7-fe385d8dc853-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Acquiring lock "cinder-quobyte-823f5d9b-7767-43a3-9bd7-fe385d8dc853" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-823f5d9b-7767-43a3-9bd7-fe385d8dc853" acquired by "delete_volume" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ddb7d7-04f1-4b5b-965b-fb870d63a986]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "cinder-5b72e08c-4d31-4da2-b7d3-3e12526d41db-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-5b72e08c-4d31-4da2-b7d3-3e12526d41db-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "cinder-quobyte-5b72e08c-4d31-4da2-b7d3-3e12526d41db" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-quobyte-5b72e08c-4d31-4da2-b7d3-3e12526d41db" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:44 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 Sep 28 15:07:44 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f59ae-061d-4e25-90a8-edcba4f4859d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Flow 'volume_create_manager' (c6de1a9f-c435-4daf-989e-6c291d8809ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d44ded1-bf9d-4ea4-8204-6391841b4d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d44ded1-bf9d-4ea4-8204-6391841b4d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2086931797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d9d74e-e317-4680-acf5-7faef820fbc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='672adadb47a346a791ae7cdd81c4532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:44Z,use_quota=True,user_id='5a0221ee399a4212bde420554b9b9bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e57a1ae-89ea-4114-99b1-ef4aad3c2a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e57a1ae-89ea-4114-99b1-ef4aad3c2a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f6b3e3-2c44-45e9-8583-c1629a80ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f6b3e3-2c44-45e9-8583-c1629a80ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70d9d74e-e317-4680-acf5-7faef820fbc5', 'volume_name': 'volume-70d9d74e-e317-4680-acf5-7faef820fbc5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1893c4-ec56-4ff4-a4d3-791eb906712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1893c4-ec56-4ff4-a4d3-791eb906712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e24ac7-0b3f-4324-bfbe-c4b1ba2649f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:44 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Volume 70d9d74e-e317-4680-acf5-7faef820fbc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70d9d74e-e317-4680-acf5-7faef820fbc5', 'volume_size': 1} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2086931797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d9d74e-e317-4680-acf5-7faef820fbc5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='672adadb47a346a791ae7cdd81c4532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:44Z,use_quota=True,user_id='5a0221ee399a4212bde420554b9b9bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Creating volume 70d9d74e-e317-4680-acf5-7faef820fbc5 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:44 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:44 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 1073741824 Sep 28 15:07:44 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:44 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853" returned: 0 in 0.601s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:44 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853 Sep 28 15:07:44 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db" returned: 0 in 0.587s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:45 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db Sep 28 15:07:45 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-823f5d9b-7767-43a3-9bd7-fe385d8dc853" returned: 0 in 0.474s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Lock "cinder-quobyte-823f5d9b-7767-43a3-9bd7-fe385d8dc853" released by "delete_volume" :: held 1.196s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Created reservations ['a96a23ba-6992-4460-9149-d16b5a6f4d4c', '4ba27295-c883-45ab-8eb3-d116470af71a', 'ac3b2bd6-396b-46e9-b6d0-fe5d2e186bf7', '32e42952-7222-41fd-a038-1657d64aefeb'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:45 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 1073741824" returned: 0 in 0.702s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:45 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:45 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 Sep 28 15:07:45 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b72e08c-4d31-4da2-b7d3-3e12526d41db" returned: 0 in 0.559s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-quobyte-5b72e08c-4d31-4da2-b7d3-3e12526d41db" released by "delete_volume" :: held 1.237s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:45 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:45 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Created reservations ['3c209192-e4ea-4b09-bd0d-ab10f24c4faf', '93a66ba7-dbf9-4947-9457-c705606c4141', '3f68cc46-1002-49f4-b2f8-e544d50feb2b', 'bc007a1b-adfa-4a5d-8d30-210d879ab053'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:45 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:45 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:45 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5" returned: 0 in 0.345s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e24ac7-0b3f-4324-bfbe-c4b1ba2649f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d9d74e-e317-4680-acf5-7faef820fbc5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5c14d7-26bc-4d23-8c6d-0c2a6c6484ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:46 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Volume volume-70d9d74e-e317-4680-acf5-7faef820fbc5 (70d9d74e-e317-4680-acf5-7faef820fbc5): created successfully Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5c14d7-26bc-4d23-8c6d-0c2a6c6484ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Flow 'volume_create_manager' (c6de1a9f-c435-4daf-989e-6c291d8809ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-26b1a3d7-c73b-4e38-98ea-99dddf0804e4 tempest-VolumesListTestJSON-1906886475 None] Created volume successfully. Sep 28 15:07:46 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.522s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Deleted volume successfully. Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2a6e4b0b-ce81-4b1f-8ae9-e648c14d5db3 tempest-VolumesCloneTest-591852968 None] Lock "cinder-823f5d9b-7767-43a3-9bd7-fe385d8dc853-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:46 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.376s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Deleted volume successfully. Sep 28 15:07:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4aa6551-a4c0-40dc-9a10-61b5b83cc62b tempest-ServerActionsTestOtherA-1449271014 None] Lock "cinder-5b72e08c-4d31-4da2-b7d3-3e12526d41db-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:47 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:47 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:47 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.743s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:07:47 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Flow 'volume_create_manager' (62ee34d8-372d-4f6b-b7f5-9f4851715e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862ca63e-474a-4aac-a47d-f413aea9c6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862ca63e-474a-4aac-a47d-f413aea9c6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1090171670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62444aa-748b-437a-a0d4-64592eff507e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='672adadb47a346a791ae7cdd81c4532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:48Z,use_quota=True,user_id='5a0221ee399a4212bde420554b9b9bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5913af83-60c3-49da-833c-a464a39ae5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5913af83-60c3-49da-833c-a464a39ae5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ddeccd-fc3d-48b2-a524-5e7b8723e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ddeccd-fc3d-48b2-a524-5e7b8723e1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62444aa-748b-437a-a0d4-64592eff507e', 'volume_name': 'volume-f62444aa-748b-437a-a0d4-64592eff507e', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c9ce78-c2fa-43af-a2f0-a35fc12a89ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c9ce78-c2fa-43af-a2f0-a35fc12a89ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f494fce6-a03a-4c0a-8060-f1ee703d6c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:48 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Volume f62444aa-748b-437a-a0d4-64592eff507e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62444aa-748b-437a-a0d4-64592eff507e', 'volume_size': 1} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1090171670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62444aa-748b-437a-a0d4-64592eff507e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='672adadb47a346a791ae7cdd81c4532a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:48Z,use_quota=True,user_id='5a0221ee399a4212bde420554b9b9bac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Creating volume f62444aa-748b-437a-a0d4-64592eff507e {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:48 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:48 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e 1073741824 Sep 28 15:07:48 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:48 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e 1073741824" returned: 0 in 0.644s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:48 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e Sep 28 15:07:48 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:49 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e" returned: 0 in 0.407s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f494fce6-a03a-4c0a-8060-f1ee703d6c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62444aa-748b-437a-a0d4-64592eff507e', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d101a9c7-e125-4a03-ae88-56cf96e08b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:49 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Volume volume-f62444aa-748b-437a-a0d4-64592eff507e (f62444aa-748b-437a-a0d4-64592eff507e): created successfully Sep 28 15:07:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d101a9c7-e125-4a03-ae88-56cf96e08b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Flow 'volume_create_manager' (62ee34d8-372d-4f6b-b7f5-9f4851715e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4bf15ca6-0575-4cc3-8712-70d338920847 tempest-VolumesListTestJSON-1906886475 None] Created volume successfully. Sep 28 15:07:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "cinder-f62444aa-748b-437a-a0d4-64592eff507e-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-f62444aa-748b-437a-a0d4-64592eff507e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "cinder-quobyte-f62444aa-748b-437a-a0d4-64592eff507e" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-quobyte-f62444aa-748b-437a-a0d4-64592eff507e" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deb67e5-3baa-45bd-9725-5773b7febd71]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e Sep 28 15:07:54 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Flow 'volume_create_manager' (8c25b89b-cc40-46aa-a774-7a9f235041d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbd7d44-42cc-4307-9851-41fc97b29e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbd7d44-42cc-4307-9851-41fc97b29e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-751431631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a00e78-b81d-42f6-9e40-8eb7b8fafc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954854d7a71e4a1081f33eb57dc8300b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:54Z,use_quota=True,user_id='5c83ea80be16404c9ae2064a6580383f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db309c-9ecb-4ff6-a68f-823a1acef459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3db309c-9ecb-4ff6-a68f-823a1acef459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3428a724-4f90-471d-93b3-9d3696eccbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3428a724-4f90-471d-93b3-9d3696eccbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a00e78-b81d-42f6-9e40-8eb7b8fafc50', 'volume_name': 'volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50', 'volume_size': 2}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61f72af-4ac4-40c7-82c3-0bfc8ddc1101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61f72af-4ac4-40c7-82c3-0bfc8ddc1101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ef46a8-2c87-4d36-b78a-5e8f0c5ff9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:54 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Volume d2a00e78-b81d-42f6-9e40-8eb7b8fafc50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50', 'volume_size': 2} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-751431631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a00e78-b81d-42f6-9e40-8eb7b8fafc50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954854d7a71e4a1081f33eb57dc8300b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:07:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:07:54Z,use_quota=True,user_id='5c83ea80be16404c9ae2064a6580383f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Creating volume d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:07:54 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 2147483648 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 2147483648 Sep 28 15:07:54 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e" returned: 0 in 0.572s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:54 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e Sep 28 15:07:54 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:54 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f62444aa-748b-437a-a0d4-64592eff507e" returned: 0 in 0.350s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-quobyte-f62444aa-748b-437a-a0d4-64592eff507e" released by "delete_volume" :: held 1.058s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Created reservations ['434a05a6-13e8-4787-82e3-df481e2b0613', '9f2dd072-63c9-4c1a-a1c2-da31fdedbb49', '5979a7ab-072d-48d3-a2c9-effda74b9e17', '1a51237f-a3b1-40c1-bb72-d61042c52bfa'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:55 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 2147483648" returned: 0 in 0.791s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:55 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:55 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 Sep 28 15:07:55 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:55 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.410s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Deleted volume successfully. Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bdad4e69-3516-4a50-bced-a30c91a07af1 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-f62444aa-748b-437a-a0d4-64592eff507e-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:55 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50" returned: 0 in 0.473s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ef46a8-2c87-4d36-b78a-5e8f0c5ff9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50', 'volume_size': 2}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c83808-23dd-46da-ba97-d7692eaeae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:07:55 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Volume volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 (d2a00e78-b81d-42f6-9e40-8eb7b8fafc50): created successfully Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c83808-23dd-46da-ba97-d7692eaeae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:07:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Flow 'volume_create_manager' (8c25b89b-cc40-46aa-a774-7a9f235041d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:07:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-59752e47-01c3-4e2f-9db3-2275e76fc436 tempest-VolumesCloneNegativeTest-659753534 None] Created volume successfully. Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "cinder-70d9d74e-e317-4680-acf5-7faef820fbc5-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-70d9d74e-e317-4680-acf5-7faef820fbc5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "cinder-quobyte-70d9d74e-e317-4680-acf5-7faef820fbc5" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-quobyte-70d9d74e-e317-4680-acf5-7faef820fbc5" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3644aff-38c0-4863-ad23-d92a51f2c772]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:56 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 Sep 28 15:07:56 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Acquiring lock "cinder-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Lock "cinder-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Acquiring lock "cinder-quobyte-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Lock "cinder-quobyte-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[64326a87-ffde-4489-9d12-10be89e46873]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 Sep 28 15:07:57 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5" returned: 0 in 0.648s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5 Sep 28 15:07:57 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-70d9d74e-e317-4680-acf5-7faef820fbc5" returned: 0 in 0.334s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-quobyte-70d9d74e-e317-4680-acf5-7faef820fbc5" released by "delete_volume" :: held 1.055s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:57 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50" returned: 0 in 0.605s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50 Sep 28 15:07:57 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Created reservations ['477334e3-0943-44e2-bc15-a5b5d52e9b0d', '25718764-6d6d-4594-8053-edccd9efe22f', 'ebe25b39-705d-4ad1-8a53-4765f491f5a0', '67c4c216-8f7f-49c5-94af-724b62fda50e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:57 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:57 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:57 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50" returned: 0 in 0.462s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Lock "cinder-quobyte-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50" released by "delete_volume" :: held 1.137s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Created reservations ['89c4ac6b-8f06-44d7-9f5c-218080f4a01c', '08acb8cd-1e11-4004-9887-fca91eda6b0b', '104461da-1c7a-4516-a57b-2eab1ea036dc', '177c0459-bcd7-49bd-a877-a688c5a41117'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:07:58 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.390s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Deleted volume successfully. Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9455df0-6ef0-4d2a-8a32-d0666745c0c9 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-70d9d74e-e317-4680-acf5-7faef820fbc5-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:58 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:07:58 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:58 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.354s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:07:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Deleted volume successfully. Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5cf59009-3b59-4b8d-b876-04b18f50d4bf tempest-VolumesCloneNegativeTest-659753534 None] Lock "cinder-d2a00e78-b81d-42f6-9e40-8eb7b8fafc50-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "cinder-3e76eeeb-90ca-4350-9ed5-79b76f015f1f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-3e76eeeb-90ca-4350-9ed5-79b76f015f1f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "cinder-quobyte-3e76eeeb-90ca-4350-9ed5-79b76f015f1f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-quobyte-3e76eeeb-90ca-4350-9ed5-79b76f015f1f" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f38dfeb-df67-45b2-b6e8-c5c3cac90bc8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:07:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:59 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f Sep 28 15:07:59 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:07:59 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 28 15:07:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f" returned: 0 in 0.677s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:07:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:07:59 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f Sep 28 15:07:59 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:00 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3e76eeeb-90ca-4350-9ed5-79b76f015f1f" returned: 0 in 0.522s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-quobyte-3e76eeeb-90ca-4350-9ed5-79b76f015f1f" released by "delete_volume" :: held 1.281s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Created reservations ['105bfb28-6950-4ae7-91dc-f620afd6e68e', '5d1f3895-e9a8-45e3-9c86-077c16829280', 'cd1ac361-2127-4aaf-8c86-c73a4b12a07f', 'a70f3925-3e6f-49f5-9e52-4649343eac45'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:00 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:08:00 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:00 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Deleted volume successfully. Sep 28 15:08:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6b7c9808-e459-481e-a3f0-8c777f816851 tempest-VolumesListTestJSON-1906886475 None] Lock "cinder-3e76eeeb-90ca-4350-9ed5-79b76f015f1f-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Flow 'volume_create_manager' (83117f69-3a77-4015-a17a-0d56a81f9c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8043a43f-5bfc-4d52-b7bd-e4911491f230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8043a43f-5bfc-4d52-b7bd-e4911491f230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-712756586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89acc5ca-ceae-4b80-9da9-06bfbc1f4392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18c21c0f3e4a35983285fbe25b47b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:09Z,use_quota=True,user_id='5e49ab905a5c40abb6eae5b282a0d154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64cadb0-706a-409a-8feb-b5ce29b9e2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64cadb0-706a-409a-8feb-b5ce29b9e2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dc6eeb-b351-4866-b6b3-27891344bf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4dc6eeb-b351-4866-b6b3-27891344bf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89acc5ca-ceae-4b80-9da9-06bfbc1f4392', 'volume_name': 'volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcc0294-daba-4ab2-b3e8-2bf1e56f913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcc0294-daba-4ab2-b3e8-2bf1e56f913a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ec6286-97af-472e-8c0d-80d52bfbf8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Volume 89acc5ca-ceae-4b80-9da9-06bfbc1f4392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392', 'volume_size': 1} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-712756586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89acc5ca-ceae-4b80-9da9-06bfbc1f4392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f18c21c0f3e4a35983285fbe25b47b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:09Z,use_quota=True,user_id='5e49ab905a5c40abb6eae5b282a0d154',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Creating volume 89acc5ca-ceae-4b80-9da9-06bfbc1f4392 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:08 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:08:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 1073741824 Sep 28 15:08:09 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:09 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 1073741824" returned: 0 in 0.703s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:09 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 Sep 28 15:08:09 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:10 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392" returned: 0 in 0.346s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ec6286-97af-472e-8c0d-80d52bfbf8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b921b6a-300d-41b9-80d0-b0d9dd73a858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:10 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Volume volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 (89acc5ca-ceae-4b80-9da9-06bfbc1f4392): created successfully Sep 28 15:08:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b921b6a-300d-41b9-80d0-b0d9dd73a858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Flow 'volume_create_manager' (83117f69-3a77-4015-a17a-0d56a81f9c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d19e6331-3ff3-4fa4-9216-0ffc3c4e7b73 tempest-VolumesNegativeTest-1680159333 None] Created volume successfully. Sep 28 15:08:20 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=97,cinder:SELECT=47,cinder:INSERT=13,cinder:DELETE=8 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:20 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=67,cinder:SELECT=55,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (ef6928ab-90c6-4f20-8a2e-797b4760b032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b0f5b4-9fa4-49c4-8930-76f1d169d82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b0f5b4-9fa4-49c4-8930-76f1d169d82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1801238609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e594e8e-364f-44dd-8c5b-a64362c51036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:27Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d0cb6b-5c4f-4cd9-ae4f-00f079e74c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13d0cb6b-5c4f-4cd9-ae4f-00f079e74c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a56a278-ed75-4c4b-8595-4042f0fcd048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a56a278-ed75-4c4b-8595-4042f0fcd048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e594e8e-364f-44dd-8c5b-a64362c51036', 'volume_name': 'volume-2e594e8e-364f-44dd-8c5b-a64362c51036', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e80e6d-7978-49b5-99da-ec5510c2879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e80e6d-7978-49b5-99da-ec5510c2879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3feaa64-7cb1-449f-a81c-7d764eaff1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:26 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Volume 2e594e8e-364f-44dd-8c5b-a64362c51036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e594e8e-364f-44dd-8c5b-a64362c51036', 'volume_size': 1} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1801238609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e594e8e-364f-44dd-8c5b-a64362c51036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:27Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Creating volume 2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:26 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:08:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:26 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 1073741824 Sep 28 15:08:26 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:27 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 1073741824" returned: 0 in 0.789s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:27 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 Sep 28 15:08:27 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:28 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036" returned: 0 in 0.481s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3feaa64-7cb1-449f-a81c-7d764eaff1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e594e8e-364f-44dd-8c5b-a64362c51036', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f66ef9-01df-4945-9b31-f4a75302ff1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:28 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Volume volume-2e594e8e-364f-44dd-8c5b-a64362c51036 (2e594e8e-364f-44dd-8c5b-a64362c51036): created successfully Sep 28 15:08:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f66ef9-01df-4945-9b31-f4a75302ff1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (ef6928ab-90c6-4f20-8a2e-797b4760b032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-77634e34-5b77-4038-b451-1936ddd2c1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Created volume successfully. Sep 28 15:08:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Creating offline snapshot dc378cb9-37cf-4f81-89e3-29fd42e0e44a of volume 2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3c7d9-6278-45e0-a9c7-80b9c84bebe5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:30 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 Sep 28 15:08:30 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:31 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036" returned: 0 in 1.320s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:31 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a 1G Sep 28 15:08:31 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:32 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a 1G" returned: 0 in 1.058s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e594e8e-364f-44dd-8c5b-a64362c51036 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:32 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e594e8e-364f-44dd-8c5b-a64362c51036 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a Sep 28 15:08:32 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:32 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e594e8e-364f-44dd-8c5b-a64362c51036 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a" returned: 0 in 0.568s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:32 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a is being set with open permissions: ugo+rw Sep 28 15:08:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:32 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a Sep 28 15:08:32 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:33 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a" returned: 0 in 0.617s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:33 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.info Sep 28 15:08:33 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:34 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.info" returned: 0 in 0.545s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:34 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.info is being set with open permissions: ugo+rw Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:34 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.info Sep 28 15:08:34 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (0d178801-a4f5-4b6d-a48a-71ece6677623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dee4af-e3c3-44ff-b6ee-7ef423bdaca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dee4af-e3c3-44ff-b6ee-7ef423bdaca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-732210148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27b638a-844f-47b5-b9d6-7ed01275abc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5539d361-c541-4dbe-ac93-cdabcc6e10d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5539d361-c541-4dbe-ac93-cdabcc6e10d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c2c163-0934-490b-94da-ee5f8bc42935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c2c163-0934-490b-94da-ee5f8bc42935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27b638a-844f-47b5-b9d6-7ed01275abc0', 'volume_name': 'volume-a27b638a-844f-47b5-b9d6-7ed01275abc0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0326678-76d9-4e5a-9ac4-c0e3807689ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0326678-76d9-4e5a-9ac4-c0e3807689ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe5f211-dae5-4152-a82b-139c71d88a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:34 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Volume a27b638a-844f-47b5-b9d6-7ed01275abc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27b638a-844f-47b5-b9d6-7ed01275abc0', 'volume_size': 1} Sep 28 15:08:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:35 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.info" returned: 0 in 1.074s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.608s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-732210148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27b638a-844f-47b5-b9d6-7ed01275abc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:34Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Creating volume a27b638a-844f-47b5-b9d6-7ed01275abc0 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:35 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:08:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:35 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 1073741824 Sep 28 15:08:35 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2ef56c87-af7b-4a09-85e0-034a3b03eef8 tempest-VolumesSnapshotTestJSON-1502667351 None] Create snapshot completed successfully Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 1073741824" returned: 0 in 1.710s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:36 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:37 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 Sep 28 15:08:37 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-dc378cb9-37cf-4f81-89e3-29fd42e0e44a-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-dc378cb9-37cf-4f81-89e3-29fd42e0e44a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.123s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-2e594e8e-364f-44dd-8c5b-a64362c51036" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2e594e8e-364f-44dd-8c5b-a64362c51036" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-dc378cb9-37cf-4f81-89e3-29fd42e0e44a" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-dc378cb9-37cf-4f81-89e3-29fd42e0e44a" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Deleting offline snapshot dc378cb9-37cf-4f81-89e3-29fd42e0e44a of volume 2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:08:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] snapshot_file for this snap is: volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c372fe-9995-48ac-b1ef-d12efcda5c26]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:38 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a Sep 28 15:08:38 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:38 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0" returned: 0 in 1.450s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] <== create_volume: return (3312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.319s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe5f211-dae5-4152-a82b-139c71d88a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27b638a-844f-47b5-b9d6-7ed01275abc0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d914b8-32e4-4879-9d69-79ab771194ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:38 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Volume volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 (a27b638a-844f-47b5-b9d6-7ed01275abc0): created successfully Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d914b8-32e4-4879-9d69-79ab771194ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (0d178801-a4f5-4b6d-a48a-71ece6677623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8c319e40-09ae-4275-845d-995fa6bd7e58 tempest-VolumesActionsTest-910915659 None] Created volume successfully. Sep 28 15:08:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1722d355-a87d-4878-8415-91325088ed1c tempest-VolumesActionsTest-910915659 None] Acquiring lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0" by "attach_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1722d355-a87d-4878-8415-91325088ed1c tempest-VolumesActionsTest-910915659 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0" acquired by "attach_volume" :: waited 0.096s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:39 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a" returned: 0 in 1.673s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e594e8e-364f-44dd-8c5b-a64362c51036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e5ba96-2a32-4f4a-b693-957c9c7e5b2e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1722d355-a87d-4878-8415-91325088ed1c tempest-VolumesActionsTest-910915659 None] Attaching volume a27b638a-844f-47b5-b9d6-7ed01275abc0 to instance f3113cb9-d694-4c25-b22c-eef22d36fcb2 at mountpoint /dev/vdb on host None. Sep 28 15:08:40 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1722d355-a87d-4878-8415-91325088ed1c tempest-VolumesActionsTest-910915659 None] Attach volume completed successfully. Sep 28 15:08:40 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 Sep 28 15:08:40 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1722d355-a87d-4878-8415-91325088ed1c tempest-VolumesActionsTest-910915659 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0" released by "attach_volume" :: held 0.409s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:41 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036" returned: 0 in 1.565s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:41 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a Sep 28 15:08:41 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:42 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a" returned: 0 in 1.444s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:42 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a Sep 28 15:08:42 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-14fa6eb9-fad3-42ba-ba3a-121b77a571af tempest-VolumesActionsTest-1060360223 None] Terminate volume connection completed successfully. Sep 28 15:08:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-14fa6eb9-fad3-42ba-ba3a-121b77a571af tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-detach_volume" by "detach_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-14fa6eb9-fad3-42ba-ba3a-121b77a571af tempest-VolumesActionsTest-1060360223 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-detach_volume" acquired by "detach_volume" :: waited 0.130s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-14fa6eb9-fad3-42ba-ba3a-121b77a571af tempest-VolumesActionsTest-1060360223 None] Detaching volume a27b638a-844f-47b5-b9d6-7ed01275abc0 from instance f3113cb9-d694-4c25-b22c-eef22d36fcb2. Sep 28 15:08:43 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036.dc378cb9-37cf-4f81-89e3-29fd42e0e44a" returned: 0 in 1.105s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-14fa6eb9-fad3-42ba-ba3a-121b77a571af tempest-VolumesActionsTest-1060360223 None] Detach volume completed successfully. Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-dc378cb9-37cf-4f81-89e3-29fd42e0e44a" released by "_delete_snapshot" :: held 6.218s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-14fa6eb9-fad3-42ba-ba3a-121b77a571af tempest-VolumesActionsTest-1060360223 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-detach_volume" released by "detach_volume" :: held 0.452s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2e594e8e-364f-44dd-8c5b-a64362c51036" released by "delete_snapshot" :: held 6.322s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['c7798f05-a2a8-4c2b-9f11-e45d80458cb3', '3d1b316f-1598-4b82-9499-a2a49c45a933', '3e149658-799d-4224-826a-7a2ad79afe05', '47e409d6-b6b8-4cfc-9baf-59163d00843a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Delete snapshot completed successfully. Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d9722174-7ab1-4f39-b8d6-8c489c71adf6 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-dc378cb9-37cf-4f81-89e3-29fd42e0e44a-delete_snapshot" released by "delete_snapshot" :: held 7.219s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e10c932c-19a8-4215-9b4c-8b481cbbcef5 tempest-VolumesActionsTest-910915659 None] Acquiring lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-detach_volume" by "detach_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e10c932c-19a8-4215-9b4c-8b481cbbcef5 tempest-VolumesActionsTest-910915659 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-detach_volume" acquired by "detach_volume" :: waited 0.056s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e10c932c-19a8-4215-9b4c-8b481cbbcef5 tempest-VolumesActionsTest-910915659 None] Volume detach called, but volume not attached. Sep 28 15:08:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e10c932c-19a8-4215-9b4c-8b481cbbcef5 tempest-VolumesActionsTest-910915659 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Acquiring lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Acquiring lock "cinder-quobyte-a27b638a-844f-47b5-b9d6-7ed01275abc0" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Lock "cinder-quobyte-a27b638a-844f-47b5-b9d6-7ed01275abc0" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:45 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d512a-06aa-4030-a8b9-6a8ebef5280c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 Sep 28 15:08:46 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:46 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0" returned: 0 in 0.833s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:46 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0 Sep 28 15:08:46 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:47 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:08:47 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (a433b71f-9252-4e0a-9161-1fd998950654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1839d-1290-4bd6-b62d-b50ff997aa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a27b638a-844f-47b5-b9d6-7ed01275abc0" returned: 0 in 0.590s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e1839d-1290-4bd6-b62d-b50ff997aa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1336949688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617ae76f-193b-4596-ba2a-9e31e75c765f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:47Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5daf152-47b0-4fc7-bae7-aae475c083bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5daf152-47b0-4fc7-bae7-aae475c083bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c7ce31-20a4-4471-9eb1-731cb2a7bb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c7ce31-20a4-4471-9eb1-731cb2a7bb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617ae76f-193b-4596-ba2a-9e31e75c765f', 'volume_name': 'volume-617ae76f-193b-4596-ba2a-9e31e75c765f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7465d61-3eb6-4248-aad7-2e743879b30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7465d61-3eb6-4248-aad7-2e743879b30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985d84d6-6329-4f82-bbbe-765c136ba37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:47 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Volume 617ae76f-193b-4596-ba2a-9e31e75c765f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617ae76f-193b-4596-ba2a-9e31e75c765f', 'volume_size': 1} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1336949688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617ae76f-193b-4596-ba2a-9e31e75c765f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:47Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Creating volume 617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:47 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Lock "cinder-quobyte-a27b638a-844f-47b5-b9d6-7ed01275abc0" released by "delete_volume" :: held 1.749s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:47 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f 1073741824 Sep 28 15:08:47 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Created reservations ['679caaba-3a32-4123-a298-c9c304d46dc8', 'd647b815-d52e-462b-b158-857c0002630f', '89ef1f23-bd86-4aa2-978f-30538a2866da', '026b891b-4b5a-4904-9345-b01afda537b6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:47 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.746s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:08:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:08:48 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:08:48 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:48 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f 1073741824" returned: 0 in 1.055s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:48 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.644s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:48 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:08:48 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Deleted volume successfully. Sep 28 15:08:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac2353d3-48a6-4ca3-a165-10f5a1dd9f1f tempest-VolumesActionsTest-910915659 None] Lock "cinder-a27b638a-844f-47b5-b9d6-7ed01275abc0-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:08:48 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f Sep 28 15:08:48 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:49 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f" returned: 0 in 0.784s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985d84d6-6329-4f82-bbbe-765c136ba37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617ae76f-193b-4596-ba2a-9e31e75c765f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a94645-e86b-4c91-bdae-eacd24654de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:49 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Volume volume-617ae76f-193b-4596-ba2a-9e31e75c765f (617ae76f-193b-4596-ba2a-9e31e75c765f): created successfully Sep 28 15:08:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a94645-e86b-4c91-bdae-eacd24654de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (a433b71f-9252-4e0a-9161-1fd998950654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0ff3c892-6368-47f8-8bec-d31ef5aeb605 tempest-VolumesSnapshotTestJSON-1502667351 None] Created volume successfully. Sep 28 15:08:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Creating offline snapshot daf175df-9e12-4d1c-9de6-eb3ca2e36329 of volume 617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:08:51 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8453b5-9630-4c1c-9a79-08ead8486437]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:51 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f Sep 28 15:08:51 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:52 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f" returned: 0 in 1.210s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:52 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 1G Sep 28 15:08:52 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:53 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 1G" returned: 0 in 1.078s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617ae76f-193b-4596-ba2a-9e31e75c765f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:53 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617ae76f-193b-4596-ba2a-9e31e75c765f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 Sep 28 15:08:53 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:54 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617ae76f-193b-4596-ba2a-9e31e75c765f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329" returned: 0 in 0.636s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:54 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 is being set with open permissions: ugo+rw Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:54 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 Sep 28 15:08:54 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (fc30771f-1022-4b83-9bfc-88f6108ebe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e835e0-bf5b-4cdf-8b8f-b99c12b3250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:54 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329" returned: 0 in 0.532s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e835e0-bf5b-4cdf-8b8f-b99c12b3250a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-485837796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85dc63a-99a9-4795-b5e7-c2f3c8156fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:55Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8acfb6d-393a-4d01-a7d4-46b2236ab2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8acfb6d-393a-4d01-a7d4-46b2236ab2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70de8bd-814d-47dd-a538-e10110758c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70de8bd-814d-47dd-a538-e10110758c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85dc63a-99a9-4795-b5e7-c2f3c8156fb0', 'volume_name': 'volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980d2767-918c-489c-b41e-649440e7142e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980d2767-918c-489c-b41e-649440e7142e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1079fb8-f44d-432c-ad14-56c91fcc48c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:55 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Volume f85dc63a-99a9-4795-b5e7-c2f3c8156fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0', 'volume_size': 1} Sep 28 15:08:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:55 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.info Sep 28 15:08:55 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:55 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.info" returned: 0 in 0.562s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:55 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.info is being set with open permissions: ugo+rw Sep 28 15:08:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:55 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.info Sep 28 15:08:55 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.info" returned: 0 in 0.518s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.833s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-485837796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85dc63a-99a9-4795-b5e7-c2f3c8156fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:55Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Creating volume f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:56 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:08:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:56 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 1073741824 Sep 28 15:08:56 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dbd09313-86c2-4dc7-81d6-b5435c5a8d4f tempest-VolumesSnapshotTestJSON-1502667351 None] Create snapshot completed successfully Sep 28 15:08:57 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 1073741824" returned: 0 in 0.970s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:57 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 Sep 28 15:08:57 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:57 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0" returned: 0 in 0.666s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:08:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1079fb8-f44d-432c-ad14-56c91fcc48c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2229facd-3581-4870-b810-5238f5a97a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Volume volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 (f85dc63a-99a9-4795-b5e7-c2f3c8156fb0): created successfully Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2229facd-3581-4870-b810-5238f5a97a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (fc30771f-1022-4b83-9bfc-88f6108ebe98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4ff18790-3680-442f-bcea-5b94bde68b20 tempest-VolumesActionsTest-910915659 None] Created volume successfully. Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (3b1e984a-2baf-411e-8b90-d7150d1af0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2d8694-3617-4241-abb9-d3ac30607bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2d8694-3617-4241-abb9-d3ac30607bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-914224254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b080773-d737-463b-9c37-73a6e31cdb93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:08:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=daf175df-9e12-4d1c-9de6-eb3ca2e36329,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:08:58Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476b25b3-f3b1-403d-85dd-9e5c3c862688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476b25b3-f3b1-403d-85dd-9e5c3c862688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd2aafb-8d63-401f-acb1-830d08d9f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd2aafb-8d63-401f-acb1-830d08d9f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b080773-d737-463b-9c37-73a6e31cdb93', 'volume_name': 'volume-7b080773-d737-463b-9c37-73a6e31cdb93', 'volume_size': 2, 'snapshot_id': 'daf175df-9e12-4d1c-9de6-eb3ca2e36329'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c3298b-2239-48e3-830d-d984ed77d355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c3298b-2239-48e3-830d-d984ed77d355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e21ced-137a-483b-b66d-462ca4385732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:08:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Volume 7b080773-d737-463b-9c37-73a6e31cdb93: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b080773-d737-463b-9c37-73a6e31cdb93', 'volume_size': 2, 'snapshot_id': 'daf175df-9e12-4d1c-9de6-eb3ca2e36329'} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-daf175df-9e12-4d1c-9de6-eb3ca2e36329-7b080773-d737-463b-9c37-73a6e31cdb93" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-daf175df-9e12-4d1c-9de6-eb3ca2e36329-7b080773-d737-463b-9c37-73a6e31cdb93" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Creating volume 7b080773-d737-463b-9c37-73a6e31cdb93 from snapshot daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-7b080773-d737-463b-9c37-73a6e31cdb93" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-7b080773-d737-463b-9c37-73a6e31cdb93" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] snapshot: daf175df-9e12-4d1c-9de6-eb3ca2e36329, volume: 7b080773-d737-463b-9c37-73a6e31cdb93, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea7aed7-cb36-44bf-9dab-290fc675404d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:58 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 Sep 28 15:08:58 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:59 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329" returned: 0 in 0.652s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-617ae76f-193b-4596-ba2a-9e31e75c765f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[171e9d1b-dcfe-428b-8613-9249fc5303bf]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:08:59 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f Sep 28 15:08:59 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-quobyte-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:08:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b4fec-fbf0-48e7-ba0d-f3798bfa7a9f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:00 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f" returned: 0 in 0.949s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:00 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 Sep 28 15:09:00 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:00 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 Sep 28 15:09:00 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:00 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0" returned: 0 in 0.726s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:00 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0 Sep 28 15:09:00 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:01 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0" returned: 0 in 0.949s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0" released by "delete_volume" :: held 1.856s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:02 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Created reservations ['842151f6-67d8-4b16-b7f3-0892b15b6351', '0a4d107a-1fb0-4366-90ff-6c84ad64a401', '09918a1f-9944-45d9-94cf-92285cc8c00d', '260256e8-d43e-4257-8473-137fdc5bf1a9'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:02 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:02 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:03 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 1.362s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:03 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Deleted volume successfully. Sep 28 15:09:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c9fbd568-e26c-4981-9b9c-c0f8280bb865 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-f85dc63a-99a9-4795-b5e7-c2f3c8156fb0-delete_volume" released by "delete_volume" :: held 4.251s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (1f58a10f-06da-47fa-bcbe-80feb63d9cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd0e252-ec67-49e7-a96f-b62c4796b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd0e252-ec67-49e7-a96f-b62c4796b45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-46773119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99226a40-e625-40a1-a248-a6f820ed7ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:05Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8756a88c-e8fc-47ba-9d2a-828c7797d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8756a88c-e8fc-47ba-9d2a-828c7797d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f185265-3021-4a7b-ac67-3fada4cada4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f185265-3021-4a7b-ac67-3fada4cada4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99226a40-e625-40a1-a248-a6f820ed7ae9', 'volume_name': 'volume-99226a40-e625-40a1-a248-a6f820ed7ae9', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e37b48-7481-4408-82ce-adb0cfa9a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e37b48-7481-4408-82ce-adb0cfa9a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9862e3b3-b9a2-459c-922b-9ae2173c2afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:06 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Volume 99226a40-e625-40a1-a248-a6f820ed7ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99226a40-e625-40a1-a248-a6f820ed7ae9', 'volume_size': 1} Sep 28 15:09:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Acquiring lock "cinder-89acc5ca-ceae-4b80-9da9-06bfbc1f4392-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Lock "cinder-89acc5ca-ceae-4b80-9da9-06bfbc1f4392-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Acquiring lock "cinder-quobyte-89acc5ca-ceae-4b80-9da9-06bfbc1f4392" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Lock "cinder-quobyte-89acc5ca-ceae-4b80-9da9-06bfbc1f4392" acquired by "delete_volume" :: waited 0.071s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:07 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d8297-4d00-4c2b-bfc3-76fa93d80988]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:07 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 Sep 28 15:09:07 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:08 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392" returned: 0 in 1.149s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:08 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392 Sep 28 15:09:08 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:09 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-89acc5ca-ceae-4b80-9da9-06bfbc1f4392" returned: 0 in 0.655s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Lock "cinder-quobyte-89acc5ca-ceae-4b80-9da9-06bfbc1f4392" released by "delete_volume" :: held 1.970s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Created reservations ['712153d2-7c11-4aa9-ba62-0d62a7e26487', '190ab4c1-8e0b-4612-86fd-2ca86b323e7e', 'a6144982-7f2b-48b1-9136-8786ed9172c2', 'c2598232-11bd-450a-81ac-f5bcfc419099'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:10 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:10 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:10 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.910s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:10 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Deleted volume successfully. Sep 28 15:09:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2eede5f4-4a81-4634-9647-9566bb9f17f2 tempest-VolumesNegativeTest-1680159333 None] Lock "cinder-89acc5ca-ceae-4b80-9da9-06bfbc1f4392-delete_volume" released by "delete_volume" :: held 3.778s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:15 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93" returned: 0 in 15.170s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f, size 1024.00 MB, duration 15.17 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:09:15 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Converted 1024.00 MB image at 67.50 MB/s Sep 28 15:09:15 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 is being set with open permissions: ugo+rw Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:15 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 Sep 28 15:09:15 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:15 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93" returned: 0 in 0.492s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-7b080773-d737-463b-9c37-73a6e31cdb93" released by "_copy_volume_from_snapshot" :: held 17.469s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-daf175df-9e12-4d1c-9de6-eb3ca2e36329-7b080773-d737-463b-9c37-73a6e31cdb93" released by "_create_volume_from_snapshot" :: held 17.591s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.618s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.908s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-46773119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99226a40-e625-40a1-a248-a6f820ed7ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:05Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Creating volume 99226a40-e625-40a1-a248-a6f820ed7ae9 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:15 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:09:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:16 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 1073741824 Sep 28 15:09:16 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e21ced-137a-483b-b66d-462ca4385732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b080773-d737-463b-9c37-73a6e31cdb93', 'volume_size': 2, 'snapshot_id': 'daf175df-9e12-4d1c-9de6-eb3ca2e36329'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0ec953-9efc-42c4-b1eb-48446078a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:16 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Volume volume-7b080773-d737-463b-9c37-73a6e31cdb93 (7b080773-d737-463b-9c37-73a6e31cdb93): created successfully Sep 28 15:09:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0ec953-9efc-42c4-b1eb-48446078a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (3b1e984a-2baf-411e-8b90-d7150d1af0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-77db83c1-367c-4f85-9bc3-d944dc60ee3a tempest-VolumesSnapshotTestJSON-1502667351 None] Created volume successfully. Sep 28 15:09:17 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-7b080773-d737-463b-9c37-73a6e31cdb93-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 1073741824" returned: 0 in 1.125s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-7b080773-d737-463b-9c37-73a6e31cdb93-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 Sep 28 15:09:17 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-7b080773-d737-463b-9c37-73a6e31cdb93" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-7b080773-d737-463b-9c37-73a6e31cdb93" acquired by "delete_volume" :: waited 0.040s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff38a560-f2aa-41ad-b21e-1bb3422ba8e7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:17 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 Sep 28 15:09:17 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:17 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9" returned: 0 in 0.744s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9862e3b3-b9a2-459c-922b-9ae2173c2afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99226a40-e625-40a1-a248-a6f820ed7ae9', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a135187b-4996-4952-a7ba-aefe8f4fca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:18 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Volume volume-99226a40-e625-40a1-a248-a6f820ed7ae9 (99226a40-e625-40a1-a248-a6f820ed7ae9): created successfully Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a135187b-4996-4952-a7ba-aefe8f4fca16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (1f58a10f-06da-47fa-bcbe-80feb63d9cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:18 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a59ccc88-c7fc-42e1-97bb-3aa72c35c10c tempest-VolumesActionsTest-910915659 None] Created volume successfully. Sep 28 15:09:18 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93" returned: 0 in 0.864s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:18 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93 Sep 28 15:09:18 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:18 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-99226a40-e625-40a1-a248-a6f820ed7ae9-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7b080773-d737-463b-9c37-73a6e31cdb93" returned: 0 in 0.644s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Lock "cinder-99226a40-e625-40a1-a248-a6f820ed7ae9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-7b080773-d737-463b-9c37-73a6e31cdb93" released by "delete_volume" :: held 1.625s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-quobyte-99226a40-e625-40a1-a248-a6f820ed7ae9" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-99226a40-e625-40a1-a248-a6f820ed7ae9" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['283daa2d-9ba4-4d49-9fd5-e3a3525f2204', '6a995586-ccfe-412f-9664-b3d43637f30d', '9652e2d0-abbf-4a6f-b2b0-9e4846b3abec', '01c7a709-079e-42d4-8020-e9edf5115cb4'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c5746-491d-4dd4-bfd0-8512e4f06b7a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:19 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:19 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 Sep 28 15:09:19 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-daf175df-9e12-4d1c-9de6-eb3ca2e36329-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.612s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-daf175df-9e12-4d1c-9de6-eb3ca2e36329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-617ae76f-193b-4596-ba2a-9e31e75c765f" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Deleted volume successfully. Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-617ae76f-193b-4596-ba2a-9e31e75c765f" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-daf175df-9e12-4d1c-9de6-eb3ca2e36329" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2575cac8-2f77-4151-8e4c-1850d2496651 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-7b080773-d737-463b-9c37-73a6e31cdb93-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-daf175df-9e12-4d1c-9de6-eb3ca2e36329" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Deleting offline snapshot daf175df-9e12-4d1c-9de6-eb3ca2e36329 of volume 617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] snapshot_file for this snap is: volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b23f87d-d89c-4cf0-935c-bbccea7bd751]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9" returned: 0 in 1.074s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:20 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9 Sep 28 15:09:20 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:20 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 Sep 28 15:09:20 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:20 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-99226a40-e625-40a1-a248-a6f820ed7ae9" returned: 0 in 0.568s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-99226a40-e625-40a1-a248-a6f820ed7ae9" released by "delete_volume" :: held 1.732s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=54,cinder:SELECT=58,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=66,cinder:UPDATE=73,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:09:20 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Created reservations ['bc54d7b0-126a-4c0a-b911-b537540e36d4', '467b32d5-6ab3-469a-850a-4946ff5b6346', '39038cb3-9b7c-40e5-a5e7-cd0aa56bc29c', 'b773280f-b324-4b06-ab9d-770688064678'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:21 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329" returned: 0 in 1.015s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-617ae76f-193b-4596-ba2a-9e31e75c765f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[de128c37-d3e2-4bbe-a8f9-c0052e3eaa40]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:21 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:21 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:21 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f Sep 28 15:09:21 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:21 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.376s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Deleted volume successfully. Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-de746508-8170-46ed-8f97-92e8d98a790e tempest-VolumesActionsTest-1060360223 None] Lock "cinder-99226a40-e625-40a1-a248-a6f820ed7ae9-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:21 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f" returned: 0 in 0.810s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:22 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 Sep 28 15:09:22 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (a29718ed-561d-41bc-bab7-b40d5a8ad904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bb03d1-dbaf-493e-a86b-1536391600d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bb03d1-dbaf-493e-a86b-1536391600d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10400554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb06ce01-1929-4c04-a2a3-bf09e28098e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:22Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa70784d-b43e-423e-b17d-71cdd3c47827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa70784d-b43e-423e-b17d-71cdd3c47827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9142bf5-104d-495c-9377-7732e08939b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9142bf5-104d-495c-9377-7732e08939b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb06ce01-1929-4c04-a2a3-bf09e28098e4', 'volume_name': 'volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b149e-8e7d-4046-a52e-21d7635d2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50b149e-8e7d-4046-a52e-21d7635d2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f46def-17a3-433e-8b71-c150e1b4ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:22 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Volume cb06ce01-1929-4c04-a2a3-bf09e28098e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4', 'volume_size': 1} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-10400554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb06ce01-1929-4c04-a2a3-bf09e28098e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:22Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Creating volume cb06ce01-1929-4c04-a2a3-bf09e28098e4 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:22 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:22 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 1073741824 Sep 28 15:09:22 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:22 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329" returned: 0 in 0.685s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:22 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329 Sep 28 15:09:22 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:23 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f.daf175df-9e12-4d1c-9de6-eb3ca2e36329" returned: 0 in 0.474s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-daf175df-9e12-4d1c-9de6-eb3ca2e36329" released by "_delete_snapshot" :: held 3.217s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-617ae76f-193b-4596-ba2a-9e31e75c765f" released by "delete_snapshot" :: held 3.283s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:23 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 1073741824" returned: 0 in 0.843s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['dbb50353-79ca-49f8-9c73-4ea4b9007282', '89f27061-3ef0-4436-abf4-f47bd5ab53b2', '48a61b62-65d0-4b0b-8731-1af8a908a243', 'bb3be442-8c19-4379-891d-680bbb283223'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:23 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 Sep 28 15:09:23 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:23 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Delete snapshot completed successfully. Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ba74ced5-0b93-491b-aae4-4ec486202b10 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-daf175df-9e12-4d1c-9de6-eb3ca2e36329-delete_snapshot" released by "delete_snapshot" :: held 3.740s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Flow 'volume_create_manager' (8987f458-269e-42fc-894c-f00684fdb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e4d6c4-1a1a-4a3f-9d90-4ffe59b13a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e4d6c4-1a1a-4a3f-9d90-4ffe59b13a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1494692253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d87720-36b5-4afc-99b6-0d3832975fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045a2a1156e248e2bb061fa35fe52b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:24Z,use_quota=True,user_id='8e0c6a2ce82c4a96b2bd5c060db7f418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04db8004-fae3-46a3-aade-50fa030d101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04db8004-fae3-46a3-aade-50fa030d101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f98aa87-289b-4fde-9c66-8e03cf0171d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f98aa87-289b-4fde-9c66-8e03cf0171d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d87720-36b5-4afc-99b6-0d3832975fa1', 'volume_name': 'volume-65d87720-36b5-4afc-99b6-0d3832975fa1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9e2004-1c01-4fce-a611-314302d78b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9e2004-1c01-4fce-a611-314302d78b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31938c52-5cbc-4061-bfeb-022ad65f0462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Volume 65d87720-36b5-4afc-99b6-0d3832975fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d87720-36b5-4afc-99b6-0d3832975fa1', 'volume_size': 1} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:23 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4" returned: 0 in 0.467s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.100s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1494692253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d87720-36b5-4afc-99b6-0d3832975fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045a2a1156e248e2bb061fa35fe52b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:24Z,use_quota=True,user_id='8e0c6a2ce82c4a96b2bd5c060db7f418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Creating volume 65d87720-36b5-4afc-99b6-0d3832975fa1 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f46def-17a3-433e-8b71-c150e1b4ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf32bd1b-f81b-47fc-bc65-9cf0d8e89824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:23 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 1073741824 Sep 28 15:09:23 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Volume volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 (cb06ce01-1929-4c04-a2a3-bf09e28098e4): created successfully Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf32bd1b-f81b-47fc-bc65-9cf0d8e89824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (a29718ed-561d-41bc-bab7-b40d5a8ad904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:23 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5f46f248-5802-493a-8078-311c5d7ba1fe tempest-VolumesActionsTest-910915659 None] Created volume successfully. Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-617ae76f-193b-4596-ba2a-9e31e75c765f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-617ae76f-193b-4596-ba2a-9e31e75c765f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-617ae76f-193b-4596-ba2a-9e31e75c765f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-617ae76f-193b-4596-ba2a-9e31e75c765f" acquired by "delete_volume" :: waited 0.045s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-cb06ce01-1929-4c04-a2a3-bf09e28098e4-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3892fd-87b7-4777-b7f0-b77ea34817e1]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Lock "cinder-cb06ce01-1929-4c04-a2a3-bf09e28098e4-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-quobyte-cb06ce01-1929-4c04-a2a3-bf09e28098e4" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-cb06ce01-1929-4c04-a2a3-bf09e28098e4" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:24 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 1073741824" returned: 0 in 0.869s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39b6ac-de84-4cef-8fdf-e0faaa2db49e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:24 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f Sep 28 15:09:24 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:24 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 Sep 28 15:09:24 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:24 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 Sep 28 15:09:24 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:25 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f" returned: 0 in 0.596s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:25 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1" returned: 0 in 0.386s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:25 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f Sep 28 15:09:25 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31938c52-5cbc-4061-bfeb-022ad65f0462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d87720-36b5-4afc-99b6-0d3832975fa1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdd2849-07d8-4767-8313-92bda736dab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:25 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Volume volume-65d87720-36b5-4afc-99b6-0d3832975fa1 (65d87720-36b5-4afc-99b6-0d3832975fa1): created successfully Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdd2849-07d8-4767-8313-92bda736dab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Flow 'volume_create_manager' (8987f458-269e-42fc-894c-f00684fdb999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fed52e01-fddc-4901-9127-97ac8cfb71c1 tempest-ServersNegativeTestJSON-1697502428 None] Created volume successfully. Sep 28 15:09:25 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4" returned: 0 in 0.653s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:25 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4 Sep 28 15:09:25 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:25 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-617ae76f-193b-4596-ba2a-9e31e75c765f" returned: 0 in 0.427s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-617ae76f-193b-4596-ba2a-9e31e75c765f" released by "delete_volume" :: held 1.203s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['0f40d28c-2162-48ab-8d08-886fd155a838', 'a2efe952-0752-4c3e-859f-dc806d2e92d9', '22777b02-4f3b-49a4-962a-b903611d4c7e', '73ade01f-9270-4017-924e-65c0d0bf7094'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:25 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cb06ce01-1929-4c04-a2a3-bf09e28098e4" returned: 0 in 0.481s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-cb06ce01-1929-4c04-a2a3-bf09e28098e4" released by "delete_volume" :: held 1.223s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:26 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:26 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Created reservations ['8ead42c8-9e2c-4f9c-ba3b-e51acc0b9145', '513c76a3-ae13-4990-ada4-7723d7a7c35f', '2cbc83cd-63a3-4cf3-87cb-b38e7c11be2f', '63ed9f53-2c31-4c5f-928a-d1c5d4c4792b'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:26 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:26 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:26 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.477s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Deleted volume successfully. Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-60cae870-38b8-438a-b894-1fdb46e789fc tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-617ae76f-193b-4596-ba2a-9e31e75c765f-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:26 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.353s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Deleted volume successfully. Sep 28 15:09:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b8c4e004-db66-49bc-b51e-5b741c4eee0a tempest-VolumesActionsTest-1060360223 None] Lock "cinder-cb06ce01-1929-4c04-a2a3-bf09e28098e4-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (2bbecfa6-c7ad-4431-bde0-fe1b56c54b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7695f063-9ead-46f7-ab46-4dcefde9933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7695f063-9ead-46f7-ab46-4dcefde9933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1549641758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a75bd78-a7d9-4817-b09f-6aacdb90c7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:28Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514212b6-6230-4298-8b08-f6d744db70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514212b6-6230-4298-8b08-f6d744db70ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b818db52-5921-457c-9b36-8ffc5f7ed14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b818db52-5921-457c-9b36-8ffc5f7ed14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a75bd78-a7d9-4817-b09f-6aacdb90c7b8', 'volume_name': 'volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325d7e65-9e6d-4eb4-b918-8403b29a0d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325d7e65-9e6d-4eb4-b918-8403b29a0d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c481331-4e05-413e-bf00-a336c6ce6557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:28 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Volume 2a75bd78-a7d9-4817-b09f-6aacdb90c7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8', 'volume_size': 1} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1549641758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a75bd78-a7d9-4817-b09f-6aacdb90c7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:28Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Creating volume 2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:28 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:28 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 1073741824 Sep 28 15:09:28 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (844d2a23-7b5b-471c-b7dd-8c8d9dc6af8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd9b8a-c005-4713-9b10-58e3cfc0042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfd9b8a-c005-4713-9b10-58e3cfc0042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297873897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710d436-2ecc-4b2f-bf44-73696155ad16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:28Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cad64f-f520-48a9-abeb-d976ae125f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1cad64f-f520-48a9-abeb-d976ae125f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620f74a7-5918-4041-86e0-9180375acfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (620f74a7-5918-4041-86e0-9180375acfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a710d436-2ecc-4b2f-bf44-73696155ad16', 'volume_name': 'volume-a710d436-2ecc-4b2f-bf44-73696155ad16', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444d5c7a-61c5-49ae-98b1-efa2e6c98d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444d5c7a-61c5-49ae-98b1-efa2e6c98d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a744a-68d4-409f-80f0-1776b671f4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:28 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Volume a710d436-2ecc-4b2f-bf44-73696155ad16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a710d436-2ecc-4b2f-bf44-73696155ad16', 'volume_size': 1} Sep 28 15:09:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:29 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 1073741824" returned: 0 in 1.046s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:29 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 Sep 28 15:09:29 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Flow 'volume_create_manager' (35903e88-8391-4659-a64e-e255a4447e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ee323e-feb5-4b79-af0b-f58c54e2793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ee323e-feb5-4b79-af0b-f58c54e2793a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-735337442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920ce82a-7ac6-4699-86d1-68d86a5b57e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045a2a1156e248e2bb061fa35fe52b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:29Z,use_quota=True,user_id='8e0c6a2ce82c4a96b2bd5c060db7f418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e13c4f9-1b2c-4d33-a380-159118a9ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e13c4f9-1b2c-4d33-a380-159118a9ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24619a0-a5bc-4720-94e5-a8cce369ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24619a0-a5bc-4720-94e5-a8cce369ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920ce82a-7ac6-4699-86d1-68d86a5b57e6', 'volume_name': 'volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c4790a-fbda-4f82-9b69-94cae26df252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8c4790a-fbda-4f82-9b69-94cae26df252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57752af9-528f-4e69-a6a9-a89d69c0f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Volume 920ce82a-7ac6-4699-86d1-68d86a5b57e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6', 'volume_size': 1} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:29 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" returned: 0 in 0.447s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.189s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-297873897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a710d436-2ecc-4b2f-bf44-73696155ad16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:28Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Creating volume a710d436-2ecc-4b2f-bf44-73696155ad16 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:29 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c481331-4e05-413e-bf00-a336c6ce6557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf910db-6857-4dfb-a26c-9feb98ce5ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:29 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 1073741824 Sep 28 15:09:29 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Volume volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 (2a75bd78-a7d9-4817-b09f-6aacdb90c7b8): created successfully Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf910db-6857-4dfb-a26c-9feb98ce5ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (2bbecfa6-c7ad-4431-bde0-fe1b56c54b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4b2320ae-ac20-4caa-86ef-b8f553ed1851 tempest-VolumesSnapshotTestJSON-1502667351 None] Created volume successfully. Sep 28 15:09:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:30 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 1073741824" returned: 0 in 0.932s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:30 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 Sep 28 15:09:30 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:31 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16" returned: 0 in 0.352s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.617s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-735337442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920ce82a-7ac6-4699-86d1-68d86a5b57e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='045a2a1156e248e2bb061fa35fe52b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:29Z,use_quota=True,user_id='8e0c6a2ce82c4a96b2bd5c060db7f418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Creating volume 920ce82a-7ac6-4699-86d1-68d86a5b57e6 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:31 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4a744a-68d4-409f-80f0-1776b671f4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a710d436-2ecc-4b2f-bf44-73696155ad16', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:31 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 1073741824 Sep 28 15:09:31 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1c6021-f1b7-4c03-b729-59842f462cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:31 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Volume volume-a710d436-2ecc-4b2f-bf44-73696155ad16 (a710d436-2ecc-4b2f-bf44-73696155ad16): created successfully Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1c6021-f1b7-4c03-b729-59842f462cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (844d2a23-7b5b-471c-b7dd-8c8d9dc6af8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-89440b78-0698-474e-b0c1-6f706eccf722 tempest-VolumesActionsTest-910915659 None] Created volume successfully. Sep 28 15:09:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-a710d436-2ecc-4b2f-bf44-73696155ad16-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-a710d436-2ecc-4b2f-bf44-73696155ad16-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:32 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 1073741824" returned: 0 in 0.975s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Acquiring lock "cinder-quobyte-a710d436-2ecc-4b2f-bf44-73696155ad16" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-a710d436-2ecc-4b2f-bf44-73696155ad16" acquired by "delete_volume" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:32 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 Sep 28 15:09:32 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8e92f6-83c6-4c1f-bce6-099bfff0c77c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:32 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 Sep 28 15:09:32 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:32 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6" returned: 0 in 0.489s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.172s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57752af9-528f-4e69-a6a9-a89d69c0f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b215a5-8bd7-4637-9977-fcc04214b52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Creating offline snapshot a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 of volume 2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:09:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Volume volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 (920ce82a-7ac6-4699-86d1-68d86a5b57e6): created successfully Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b215a5-8bd7-4637-9977-fcc04214b52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Flow 'volume_create_manager' (35903e88-8391-4659-a64e-e255a4447e5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c41efa-b3cf-4827-ac53-f6e5e788e18d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:32 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-12f1b206-ec72-451f-bc89-3a6efffb0515 tempest-ServersNegativeTestJSON-1697502428 None] Created volume successfully. Sep 28 15:09:32 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16" returned: 0 in 0.675s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:32 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 Sep 28 15:09:32 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:32 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16 Sep 28 15:09:32 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:33 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" returned: 0 in 0.675s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:33 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 1G Sep 28 15:09:33 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:33 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a710d436-2ecc-4b2f-bf44-73696155ad16" returned: 0 in 0.576s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-quobyte-a710d436-2ecc-4b2f-bf44-73696155ad16" released by "delete_volume" :: held 1.334s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Created reservations ['e53a0481-2576-42e9-9146-d6ab14db641a', 'c794d39c-2acc-4d2a-a0c9-2bd209f1448e', '77b250cf-2661-4686-a46d-654ed8633de0', '91102eb2-61f3-41f3-b1c2-aea898b74721'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:33 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:33 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:34 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 1G" returned: 0 in 0.827s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:34 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 Sep 28 15:09:34 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:34 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.488s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:34 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Deleted volume successfully. Sep 28 15:09:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-695cc915-10d0-4e3e-950d-ed748cf59ea4 tempest-VolumesActionsTest-1060360223 None] Lock "cinder-a710d436-2ecc-4b2f-bf44-73696155ad16-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:34 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" returned: 0 in 0.627s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:34 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 is being set with open permissions: ugo+rw Sep 28 15:09:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:34 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 Sep 28 15:09:34 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "cinder-920ce82a-7ac6-4699-86d1-68d86a5b57e6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-920ce82a-7ac6-4699-86d1-68d86a5b57e6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "cinder-quobyte-920ce82a-7ac6-4699-86d1-68d86a5b57e6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-quobyte-920ce82a-7ac6-4699-86d1-68d86a5b57e6" acquired by "delete_volume" :: waited 0.053s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[029f0786-81f0-4a4f-9eb2-08d51bffae02]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:35 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" returned: 0 in 0.670s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:35 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.info Sep 28 15:09:35 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:35 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 Sep 28 15:09:35 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (d3085cae-d593-438f-aaff-b57104ba4d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467749a7-4e67-464d-aa41-9eb55761f048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467749a7-4e67-464d-aa41-9eb55761f048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-955378394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e774795d-95b1-4094-a20c-c68db6bcace1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:36Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88131f6c-d03a-46b1-8518-553e3e5eb110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88131f6c-d03a-46b1-8518-553e3e5eb110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8b2db0-298c-40c7-8508-9a32e7bceb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8b2db0-298c-40c7-8508-9a32e7bceb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e774795d-95b1-4094-a20c-c68db6bcace1', 'volume_name': 'volume-e774795d-95b1-4094-a20c-c68db6bcace1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67873158-8627-46e2-b234-316badd6351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67873158-8627-46e2-b234-316badd6351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c645cc0-26c4-4213-b44d-ad0553663041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:36 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Volume e774795d-95b1-4094-a20c-c68db6bcace1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e774795d-95b1-4094-a20c-c68db6bcace1', 'volume_size': 1} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:36 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.info" returned: 0 in 0.539s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.info is being set with open permissions: ugo+rw Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.info Sep 28 15:09:36 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6" returned: 0 in 0.807s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6 Sep 28 15:09:36 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.info" returned: 0 in 0.544s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.121s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-955378394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e774795d-95b1-4094-a20c-c68db6bcace1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='329fc9cdeca54d408f0b667b35555ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:36Z,use_quota=True,user_id='20c8ca230bf7413cb7ee7cb86a64bbca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Creating volume e774795d-95b1-4094-a20c-c68db6bcace1 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:36 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:36 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-920ce82a-7ac6-4699-86d1-68d86a5b57e6" returned: 0 in 0.523s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:36 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 1073741824 Sep 28 15:09:36 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-quobyte-920ce82a-7ac6-4699-86d1-68d86a5b57e6" released by "delete_volume" :: held 1.465s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-387021a5-361f-47d6-9730-382d0a9a9b2f tempest-VolumesSnapshotTestJSON-1502667351 None] Create snapshot completed successfully Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Created reservations ['f3cd70a9-9d92-4f4f-9ae1-3e5dc1ce6dc5', '4dfcc30e-4c36-43d9-becc-2aed99e07723', 'aeb917ef-f48c-4bd0-8046-ae9d14d3db4c', '820acc6f-7a5c-44cf-80fa-d53ee05c9876'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:37 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.434s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Deleted volume successfully. Sep 28 15:09:37 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 1073741824" returned: 0 in 0.919s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-02cd34a9-c943-4e98-a809-d0bc916d06f8 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-920ce82a-7ac6-4699-86d1-68d86a5b57e6-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "cinder-65d87720-36b5-4afc-99b6-0d3832975fa1-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:37 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-65d87720-36b5-4afc-99b6-0d3832975fa1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:37 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "cinder-quobyte-65d87720-36b5-4afc-99b6-0d3832975fa1" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-quobyte-65d87720-36b5-4afc-99b6-0d3832975fa1" acquired by "delete_volume" :: waited 0.054s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0873dbd6-95a5-4ed9-869c-cf4c938ee355]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:09:38 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 Sep 28 15:09:38 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (1f8ee3d4-d685-452b-b08e-207facbc513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:38 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b27123-90b1-411c-a50d-806de6f62e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1" returned: 0 in 0.541s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b27123-90b1-411c-a50d-806de6f62e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1056232036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb1b56b1-55f1-42d9-9007-74d502f00534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1078e0fd9ecc4392baab14bb59d3a413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:09:38Z,use_quota=True,user_id='91a199d20f55465a8fa75cb7445978bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bedb5b9-870e-4057-b97f-2c86a6687c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bedb5b9-870e-4057-b97f-2c86a6687c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a27703-00b6-4ed4-8a4a-035a4c86105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a27703-00b6-4ed4-8a4a-035a4c86105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb1b56b1-55f1-42d9-9007-74d502f00534', 'volume_name': 'volume-eb1b56b1-55f1-42d9-9007-74d502f00534', 'volume_size': 1, 'snapshot_id': 'a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d98562-edb1-42c6-a1d0-1919fe80d315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d98562-edb1-42c6-a1d0-1919fe80d315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247ddb37-2b38-48f9-ac5d-7ae8ed63bd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Volume eb1b56b1-55f1-42d9-9007-74d502f00534: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb1b56b1-55f1-42d9-9007-74d502f00534', 'volume_size': 1, 'snapshot_id': 'a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1'} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c645cc0-26c4-4213-b44d-ad0553663041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e774795d-95b1-4094-a20c-c68db6bcace1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80e0bc2-329e-4c97-8014-a9486c418eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1-eb1b56b1-55f1-42d9-9007-74d502f00534" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:38 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Volume volume-e774795d-95b1-4094-a20c-c68db6bcace1 (e774795d-95b1-4094-a20c-c68db6bcace1): created successfully Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80e0bc2-329e-4c97-8014-a9486c418eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Flow 'volume_create_manager' (d3085cae-d593-438f-aaff-b57104ba4d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1-eb1b56b1-55f1-42d9-9007-74d502f00534" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Creating volume eb1b56b1-55f1-42d9-9007-74d502f00534 from snapshot a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-eb1b56b1-55f1-42d9-9007-74d502f00534" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-eb1b56b1-55f1-42d9-9007-74d502f00534" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] snapshot: a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1, volume: eb1b56b1-55f1-42d9-9007-74d502f00534, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:09:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-88c601c9-5ae5-4f86-a1e6-591bfadc62dc tempest-VolumesActionsTest-910915659 None] Created volume successfully. Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa1a65-c9ca-4ca1-bbe8-308297768ee8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:38 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1" returned: 0 in 0.671s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:38 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 Sep 28 15:09:38 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:38 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1 Sep 28 15:09:38 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:39 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-65d87720-36b5-4afc-99b6-0d3832975fa1" returned: 0 in 0.445s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-quobyte-65d87720-36b5-4afc-99b6-0d3832975fa1" released by "delete_volume" :: held 1.221s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:39 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" returned: 0 in 0.759s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[9089510c-7752-4610-9f65-13d1febde43b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Created reservations ['f13feea2-299f-4153-b362-ca71b3d8419a', '5ff97e2a-c903-45f2-8a08-01c4de9f9d9a', '8f219783-e9a8-4a98-a2e0-33e97830f454', 'ded224fe-2068-4b3f-9f5d-f9bbc1e7659e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:39 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 Sep 28 15:09:39 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:39 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:39 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:39 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.390s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Deleted volume successfully. Sep 28 15:09:39 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" returned: 0 in 0.630s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:09:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:09:40 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:09:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ed69a9a-7682-4a48-b8d4-c44a8dfe4b27 tempest-ServersNegativeTestJSON-1697502428 None] Lock "cinder-65d87720-36b5-4afc-99b6-0d3832975fa1-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:40 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 Sep 28 15:09:40 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Acquiring lock "cinder-e774795d-95b1-4094-a20c-c68db6bcace1-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Lock "cinder-e774795d-95b1-4094-a20c-c68db6bcace1-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Acquiring lock "cinder-quobyte-e774795d-95b1-4094-a20c-c68db6bcace1" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Lock "cinder-quobyte-e774795d-95b1-4094-a20c-c68db6bcace1" acquired by "delete_volume" :: waited 0.048s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd6ef4-ecaa-4248-ae62-14cfd98f079c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:41 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 Sep 28 15:09:41 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:43 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1" returned: 0 in 1.840s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:43 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1 Sep 28 15:09:43 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:43 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e774795d-95b1-4094-a20c-c68db6bcace1" returned: 0 in 0.905s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Lock "cinder-quobyte-e774795d-95b1-4094-a20c-c68db6bcace1" released by "delete_volume" :: held 2.914s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Created reservations ['d1429d6c-68a3-41df-bd7a-08fad570ba6d', '17423e8c-3ae7-4207-be74-c1eab251781a', '6ab448fd-bf79-41da-bfbf-fbd7d14a07f2', 'c0f73975-4ad7-426f-9836-a44ae2b73dbc'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:44 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:44 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:45 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.997s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:45 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Deleted volume successfully. Sep 28 15:09:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4955b2ac-c56e-4ec3-9563-51abdcbc89d8 tempest-VolumesActionsTest-910915659 None] Lock "cinder-e774795d-95b1-4094-a20c-c68db6bcace1-delete_volume" released by "delete_volume" :: held 4.724s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:47 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:47 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:48 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.851s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:48 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:48 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:09:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:09:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:09:52 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534" returned: 0 in 12.017s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8, size 1024.00 MB, duration 12.02 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:09:52 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Converted 1024.00 MB image at 85.21 MB/s Sep 28 15:09:52 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 is being set with open permissions: ugo+rw Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:52 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 Sep 28 15:09:52 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:52 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534" returned: 0 in 0.375s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-eb1b56b1-55f1-42d9-9007-74d502f00534" released by "_copy_volume_from_snapshot" :: held 13.911s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1-eb1b56b1-55f1-42d9-9007-74d502f00534" released by "_create_volume_from_snapshot" :: held 14.013s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.048s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247ddb37-2b38-48f9-ac5d-7ae8ed63bd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1b56b1-55f1-42d9-9007-74d502f00534', 'volume_size': 1, 'snapshot_id': 'a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a2b7b3-49b1-46c6-8d71-1511115fd0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:09:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Volume volume-eb1b56b1-55f1-42d9-9007-74d502f00534 (eb1b56b1-55f1-42d9-9007-74d502f00534): created successfully Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a2b7b3-49b1-46c6-8d71-1511115fd0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:09:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Flow 'volume_create_manager' (1f8ee3d4-d685-452b-b08e-207facbc513f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:09:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-22b1798b-7e7b-4766-89d5-d19f171a5d0e tempest-VolumesSnapshotTestJSON-1502667351 None] Created volume successfully. Sep 28 15:09:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-eb1b56b1-55f1-42d9-9007-74d502f00534-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-eb1b56b1-55f1-42d9-9007-74d502f00534-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-eb1b56b1-55f1-42d9-9007-74d502f00534" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-eb1b56b1-55f1-42d9-9007-74d502f00534" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:53 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79e6b15-1418-48e0-8ced-d51b5c6d4674]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:53 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 Sep 28 15:09:53 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:54 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534" returned: 0 in 0.525s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:54 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534 Sep 28 15:09:54 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:54 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-eb1b56b1-55f1-42d9-9007-74d502f00534" returned: 0 in 0.317s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-eb1b56b1-55f1-42d9-9007-74d502f00534" released by "delete_volume" :: held 0.913s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['6f9b637f-fbe5-41c7-9bba-c014280b5670', '7928921b-42cb-42d6-8479-40614cdbd345', '972bff92-17ee-4f77-bfbf-71eb9ed3f3ed', 'd21769c3-8034-40dd-8f58-a6346b08dc33'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:09:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:54 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:09:54 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:55 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.356s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:55 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:09:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Deleted volume successfully. Sep 28 15:09:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-21bd2d19-65db-41cd-b088-2958485f7474 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-eb1b56b1-55f1-42d9-9007-74d502f00534-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Deleting offline snapshot a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 of volume 2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] snapshot_file for this snap is: volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82403b4-f77e-4e00-8e31-861326d0b33a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:56 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 Sep 28 15:09:56 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:56 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" returned: 0 in 0.675s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15bd62e-7537-4106-b5df-20cdf9979a23]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:57 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 Sep 28 15:09:57 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:57 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" returned: 0 in 0.824s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:57 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 Sep 28 15:09:57 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:58 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" returned: 0 in 0.519s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:58 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1 Sep 28 15:09:58 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:09:58 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Sep 28 15:09:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8.a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" returned: 0 in 0.433s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:09:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1" released by "_delete_snapshot" :: held 2.657s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" released by "delete_snapshot" :: held 2.694s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:58 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['25b5b325-6f20-49d3-ab5a-f047f6cc3e0f', 'ebcb7676-1d5f-4f2d-902c-47dc8c358598', '12bddc2d-ed16-4bca-b199-c002f5ecc347', '09fb9ba5-659f-46ea-954e-a1de90688058'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:09:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Delete snapshot completed successfully. Sep 28 15:09:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-574ebb54-efba-4890-8d83-fd59034be1fe tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-a4b770c4-8f9c-453c-b5f0-51a75a4d4ea1-delete_snapshot" released by "delete_snapshot" :: held 2.956s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:09:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:09:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:09:59 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aeeee2-a423-474e-aa64-9f90cbcdfade]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:09:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:09:59 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 Sep 28 15:09:59 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:00 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" returned: 0 in 0.539s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:00 devstack sudo[95256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8 Sep 28 15:10:00 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:00 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" returned: 0 in 0.408s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8" released by "delete_volume" :: held 1.079s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['999c5dd7-f9e8-4f97-aa12-3743ad66a9a4', 'f17c5a5a-57c3-4fc7-946a-87ab5d49bb48', '5c2c122e-9c0e-4671-84f7-0ce8a7686a7c', '54dd350e-d662-4ccc-9e58-20a6e0ba382d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:00 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:10:00 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:01 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.338s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:01 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:01 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Deleted volume successfully. Sep 28 15:10:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5ebf0971-c228-4f62-a53c-2fbe919fba2c tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-2a75bd78-a7d9-4817-b09f-6aacdb90c7b8-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-2e594e8e-364f-44dd-8c5b-a64362c51036-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-2e594e8e-364f-44dd-8c5b-a64362c51036-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "cinder-quobyte-2e594e8e-364f-44dd-8c5b-a64362c51036" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2e594e8e-364f-44dd-8c5b-a64362c51036" acquired by "delete_volume" :: waited 0.049s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:02 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f77b275-ea6e-4490-a020-94fb9bd5402c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:02 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 Sep 28 15:10:02 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:02 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036" returned: 0 in 0.592s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:02 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036 Sep 28 15:10:02 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:03 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-2e594e8e-364f-44dd-8c5b-a64362c51036" returned: 0 in 0.586s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-quobyte-2e594e8e-364f-44dd-8c5b-a64362c51036" released by "delete_volume" :: held 1.345s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Created reservations ['a600db19-eced-4216-ba73-9cf18f8eee89', '4626f28e-2323-4f0f-9241-cf205567af7c', 'a97c6a4f-1049-4ef2-ae1b-e71bd3eb05ba', '18da0af5-6d6d-435c-84a9-b7dfb609ca29'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:03 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:10:03 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:04 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.444s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:04 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Deleted volume successfully. Sep 28 15:10:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-96d2ff26-8b03-4848-9cda-0b774ef57d30 tempest-VolumesSnapshotTestJSON-1502667351 None] Lock "cinder-2e594e8e-364f-44dd-8c5b-a64362c51036-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:09 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Flow 'volume_create_manager' (2f6ae18e-d046-4634-acc2-ddacee43792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb826a2f-976c-4ef0-80fd-df27ca1c7451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb826a2f-976c-4ef0-80fd-df27ca1c7451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-523247492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29635e52-05a4-468d-b88f-0e1b5cc0b992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102abd32ccc649f48ad8d7bbe240457b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:10Z,use_quota=True,user_id='0e1311259acb4a7e8a9a40021db79efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc8dd35a-e16a-4030-9aad-50c4996cc790),volume_type_id=fc8dd35a-e16a-4030-9aad-50c4996cc790)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ef93b1-865c-47ed-afd2-fb303795cd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ef93b1-865c-47ed-afd2-fb303795cd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b887cb3-8dbf-4317-8331-53881338d5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b887cb3-8dbf-4317-8331-53881338d5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29635e52-05a4-468d-b88f-0e1b5cc0b992', 'volume_name': 'volume-29635e52-05a4-468d-b88f-0e1b5cc0b992', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9248cf2-2245-455e-b7c7-2254f1d136cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9248cf2-2245-455e-b7c7-2254f1d136cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4395923d-c3f2-4ca0-b107-b3baf2b88a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:10 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Volume 29635e52-05a4-468d-b88f-0e1b5cc0b992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29635e52-05a4-468d-b88f-0e1b5cc0b992', 'volume_size': 1} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-523247492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29635e52-05a4-468d-b88f-0e1b5cc0b992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102abd32ccc649f48ad8d7bbe240457b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:10Z,use_quota=True,user_id='0e1311259acb4a7e8a9a40021db79efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc8dd35a-e16a-4030-9aad-50c4996cc790),volume_type_id=fc8dd35a-e16a-4030-9aad-50c4996cc790)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Creating volume 29635e52-05a4-468d-b88f-0e1b5cc0b992 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:10 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:10 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 1073741824 Sep 28 15:10:10 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Flow 'volume_create_manager' (13e91afb-e207-4f57-90c5-728a237eab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d6ed0-7c40-497c-8b4e-46f0b5a4c4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d6ed0-7c40-497c-8b4e-46f0b5a4c4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1325872520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cda7ae2-1034-4650-8777-c3bcf2822a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102abd32ccc649f48ad8d7bbe240457b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:11Z,use_quota=True,user_id='0e1311259acb4a7e8a9a40021db79efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b57348a-76bd-41db-baeb-03e172e37874),volume_type_id=6b57348a-76bd-41db-baeb-03e172e37874)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f5db32-0cc2-49b6-a751-3b4fb156b489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f5db32-0cc2-49b6-a751-3b4fb156b489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa08d1d-5514-450c-8767-26840d864b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa08d1d-5514-450c-8767-26840d864b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cda7ae2-1034-4650-8777-c3bcf2822a8b', 'volume_name': 'volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f80835-05c7-4efb-8348-ddd8d08aef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f80835-05c7-4efb-8348-ddd8d08aef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241927e-eff1-426b-975d-aa1c7bc90311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Volume 9cda7ae2-1034-4650-8777-c3bcf2822a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b', 'volume_size': 1} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:11 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 1073741824" returned: 0 in 0.975s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:11 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 Sep 28 15:10:11 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:11 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992" returned: 0 in 0.408s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1325872520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cda7ae2-1034-4650-8777-c3bcf2822a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102abd32ccc649f48ad8d7bbe240457b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:11Z,use_quota=True,user_id='0e1311259acb4a7e8a9a40021db79efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b57348a-76bd-41db-baeb-03e172e37874),volume_type_id=6b57348a-76bd-41db-baeb-03e172e37874)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Creating volume 9cda7ae2-1034-4650-8777-c3bcf2822a8b {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:11 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4395923d-c3f2-4ca0-b107-b3baf2b88a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29635e52-05a4-468d-b88f-0e1b5cc0b992', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b 1073741824 Sep 28 15:10:11 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e9e677-a7f7-42b2-8335-1c181092dc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:11 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Volume volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 (29635e52-05a4-468d-b88f-0e1b5cc0b992): created successfully Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e9e677-a7f7-42b2-8335-1c181092dc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Flow 'volume_create_manager' (2f6ae18e-d046-4634-acc2-ddacee43792f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d4a70069-e03f-4f98-8624-1f5739da203a tempest-TestInstancesWithCinderVolumes-253577244 None] Created volume successfully. Sep 28 15:10:12 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b 1073741824" returned: 0 in 0.832s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:12 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b Sep 28 15:10:12 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Flow 'volume_create_manager' (d5976983-6892-4b59-bcf5-1a77ddf9495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a2a968-05a7-41bd-a113-a7e724df3aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a2a968-05a7-41bd-a113-a7e724df3aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2095653492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9519ef96-bc0c-4af1-87c3-69830b752eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102abd32ccc649f48ad8d7bbe240457b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:13Z,use_quota=True,user_id='0e1311259acb4a7e8a9a40021db79efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85b5dd67-c0e4-4dcb-834b-a41bd0225d30),volume_type_id=85b5dd67-c0e4-4dcb-834b-a41bd0225d30)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba35f115-5c76-41e0-b87b-8ec0d40c7ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba35f115-5c76-41e0-b87b-8ec0d40c7ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cb39ee-762e-42ee-ade8-74d76c12800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:12 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:10:13 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b" returned: 0 in 0.585s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5241927e-eff1-426b-975d-aa1c7bc90311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32da7e6e-44c3-4459-8803-8191a52d6f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Volume volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b (9cda7ae2-1034-4650-8777-c3bcf2822a8b): created successfully Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32da7e6e-44c3-4459-8803-8191a52d6f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Flow 'volume_create_manager' (13e91afb-e207-4f57-90c5-728a237eab6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1b34ed02-c7e1-4899-922e-e69ea63e038c tempest-TestInstancesWithCinderVolumes-253577244 None] Created volume successfully. Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cb39ee-762e-42ee-ade8-74d76c12800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9519ef96-bc0c-4af1-87c3-69830b752eb6', 'volume_name': 'volume-9519ef96-bc0c-4af1-87c3-69830b752eb6', 'volume_size': 1, 'image_id': 'c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1847334092', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '102abd32ccc649f48ad8d7bbe240457b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'created_at': datetime.datetime(2026, 9, 28, 13, 10, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87/file', 'properties': {}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e53b0f1-de09-4ca0-85d9-852a3a8f3ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e53b0f1-de09-4ca0-85d9-852a3a8f3ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7ae91d-3d67-41c6-8f49-289e79ef2201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Volume 9519ef96-bc0c-4af1-87c3-69830b752eb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9519ef96-bc0c-4af1-87c3-69830b752eb6', 'volume_size': 1, 'image_id': 'c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1847334092', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '102abd32ccc649f48ad8d7bbe240457b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'created_at': datetime.datetime(2026, 9, 28, 13, 10, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87/file', 'properties': {}}, 'image_service': } Sep 28 15:10:13 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Trying to clone 9519ef96-bc0c-4af1-87c3-69830b752eb6 from image c3388903-aee0-4c8e-bed5-c168a8fa7c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:10:18 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD, size 20.69 MB, duration 5.45 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:10:18 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Image download 20.69 MB at 3.80 MB/s Sep 28 15:10:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f6f82-cfe1-4895-8ea0-105c4b4b586c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD Sep 28 15:10:19 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:19 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:19 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Temporary image c3388903-aee0-4c8e-bed5-c168a8fa7c87 is fetched for user 0e1311259acb4a7e8a9a40021db79efa. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:10:19 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efafae0-25a4-4d4f-8fe2-de9b2e1cac81]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:19 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD Sep 28 15:10:19 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:20 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD" returned: 0 in 0.602s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2095653492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9519ef96-bc0c-4af1-87c3-69830b752eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='102abd32ccc649f48ad8d7bbe240457b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:13Z,use_quota=True,user_id='0e1311259acb4a7e8a9a40021db79efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85b5dd67-c0e4-4dcb-834b-a41bd0225d30),volume_type_id=85b5dd67-c0e4-4dcb-834b-a41bd0225d30)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Creating volume 9519ef96-bc0c-4af1-87c3-69830b752eb6 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:20 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:10:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:20 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 1073741824 Sep 28 15:10:20 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 1073741824" returned: 0 in 0.863s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:INSERT=26,cinder:UPDATE=117,cinder:SELECT=90,cinder:DELETE=9 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=79,cinder:INSERT=33,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:21 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 Sep 28 15:10:21 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:21 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6" returned: 0 in 0.588s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Attempting download of c3388903-aee0-4c8e-bed5-c168a8fa7c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'metadata': {}}])) to volume 9519ef96-bc0c-4af1-87c3-69830b752eb6. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4cb380-b63f-4042-8b62-31fdd157e144]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3388903-aee0-4c8e-bed5-c168a8fa7c87_xn3raa3c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:22 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3388903-aee0-4c8e-bed5-c168a8fa7c87_xn3raa3c Sep 28 15:10:22 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:22 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3388903-aee0-4c8e-bed5-c168a8fa7c87_xn3raa3c" returned: 0 in 0.769s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3388903-aee0-4c8e-bed5-c168a8fa7c87_xn3raa3c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:22 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3388903-aee0-4c8e-bed5-c168a8fa7c87_xn3raa3c Sep 28 15:10:22 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Flow 'volume_create_manager' (9bcecb2f-d80a-4ca2-bc5c-a7eb47f2d04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b641bc-2bd9-4fb6-b35a-2a6def5c5652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b641bc-2bd9-4fb6-b35a-2a6def5c5652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-169485110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e8bf0a-5d42-4b02-94f6-16c478213322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8928f130902649dc9f66ccabef9166b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:23Z,use_quota=True,user_id='4e69a8d142c14f419f2127c9d05679ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a0d873-dbc8-4379-b159-786493c5e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a0d873-dbc8-4379-b159-786493c5e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1a04a2-f282-4de5-8104-e16846ccba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1a04a2-f282-4de5-8104-e16846ccba61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e8bf0a-5d42-4b02-94f6-16c478213322', 'volume_name': 'volume-f0e8bf0a-5d42-4b02-94f6-16c478213322', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a2c605-3370-411e-affe-f2ee25499849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a2c605-3370-411e-affe-f2ee25499849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd46de1-f9df-42b8-8328-dd0642a67696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Volume f0e8bf0a-5d42-4b02-94f6-16c478213322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e8bf0a-5d42-4b02-94f6-16c478213322', 'volume_size': 1} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-169485110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e8bf0a-5d42-4b02-94f6-16c478213322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8928f130902649dc9f66ccabef9166b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:23Z,use_quota=True,user_id='4e69a8d142c14f419f2127c9d05679ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Creating volume f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:23 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 1073741824 Sep 28 15:10:23 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:23 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3388903-aee0-4c8e-bed5-c168a8fa7c87_xn3raa3c" returned: 1 in 0.670s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3388903-aee0-4c8e-bed5-c168a8fa7c87_xn3raa3c' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eb5a14-47ab-4da2-bc9b-1c31f826dbcf]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:23 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD Sep 28 15:10:23 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:23 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 1073741824" returned: 0 in 0.912s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:24 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD" returned: 0 in 0.708s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] c3388903-aee0-4c8e-bed5-c168a8fa7c87 was qcow2, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:24 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 Sep 28 15:10:24 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 Sep 28 15:10:24 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:24 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:24 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322" returned: 0 in 0.446s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd46de1-f9df-42b8-8328-dd0642a67696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e8bf0a-5d42-4b02-94f6-16c478213322', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8eee2c-d874-4955-a037-5f0842801e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Volume volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 (f0e8bf0a-5d42-4b02-94f6-16c478213322): created successfully Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8eee2c-d874-4955-a037-5f0842801e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Flow 'volume_create_manager' (9bcecb2f-d80a-4ca2-bc5c-a7eb47f2d04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6a57b8af-13e2-47cf-8c1b-49860f8b8829 tempest-VolumesSnapshotListTestJSON-2037124372 None] Created volume successfully. Sep 28 15:10:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Creating offline snapshot 8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d of volume f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:25 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5d49b8-7a0a-42a9-8756-ef51489bf977]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:25 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 Sep 28 15:10:25 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:26 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322" returned: 0 in 0.887s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:26 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d 1G Sep 28 15:10:26 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:27 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d 1G" returned: 0 in 0.920s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:27 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d Sep 28 15:10:27 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:27 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6" returned: 0 in 3.649s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:27 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3388903-aee0-4c8e-bed5-c168a8fa7c87_jkahh98adevstack@QuobyteHD, size 112.00 MB, duration 3.65 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:10:27 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Converted 112.00 MB image at 30.68 MB/s Sep 28 15:10:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:27 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 1G Sep 28 15:10:27 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:28 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" returned: 0 in 0.657s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:28 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d is being set with open permissions: ugo+rw Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:28 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d Sep 28 15:10:28 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:28 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 1G" returned: 0 in 0.688s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Downloaded image c3388903-aee0-4c8e-bed5-c168a8fa7c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'metadata': {}}])) to volume 9519ef96-bc0c-4af1-87c3-69830b752eb6 successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Temporary image c3388903-aee0-4c8e-bed5-c168a8fa7c87 for user 0e1311259acb4a7e8a9a40021db79efa is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Marking volume 9519ef96-bc0c-4af1-87c3-69830b752eb6 as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:10:28 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Copying metadata from image c3388903-aee0-4c8e-bed5-c168a8fa7c87 to 9519ef96-bc0c-4af1-87c3-69830b752eb6. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Creating volume glance metadata for volume 9519ef96-bc0c-4af1-87c3-69830b752eb6 backed by image c3388903-aee0-4c8e-bed5-c168a8fa7c87 with: {'image_id': 'c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'image_name': 'tempest-scenario-img--1847334092', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" returned: 0 in 0.456s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:28 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.info Sep 28 15:10:28 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7ae91d-3d67-41c6-8f49-289e79ef2201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9519ef96-bc0c-4af1-87c3-69830b752eb6', 'volume_size': 1, 'image_id': 'c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1847334092', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '102abd32ccc649f48ad8d7bbe240457b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c3388903-aee0-4c8e-bed5-c168a8fa7c87', 'created_at': datetime.datetime(2026, 9, 28, 13, 10, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3388903-aee0-4c8e-bed5-c168a8fa7c87/file', 'properties': {}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05abd23d-a8b5-4eae-a6d0-8a31abedc050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:28 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Volume volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 (9519ef96-bc0c-4af1-87c3-69830b752eb6): created successfully Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05abd23d-a8b5-4eae-a6d0-8a31abedc050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Flow 'volume_create_manager' (d5976983-6892-4b59-bcf5-1a77ddf9495b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5a6786f1-9829-40d7-a297-ceb0dd379d78 tempest-TestInstancesWithCinderVolumes-253577244 None] Created volume successfully. Sep 28 15:10:29 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.info" returned: 0 in 0.552s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:29 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.info is being set with open permissions: ugo+rw Sep 28 15:10:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:29 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.info Sep 28 15:10:29 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:29 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.info" returned: 0 in 0.572s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.265s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-32704f38-2662-493c-8979-52627f1a70e6 tempest-VolumesSnapshotListTestJSON-2037124372 None] Create snapshot completed successfully Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Flow 'volume_create_manager' (9bcaabe0-45dc-4252-93ae-61a104f2ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bfa2ef-091d-4b5f-8fef-ddfd3a3cf781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bfa2ef-091d-4b5f-8fef-ddfd3a3cf781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1171345499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51eabac3-1955-446f-9ab2-731d3b271252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0f28a1f046483ba586b94ce26636f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:30Z,use_quota=True,user_id='fd5fae121dc943558262bf8f814ccbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f02cc1-fd12-445a-91b5-02ac2450be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f02cc1-fd12-445a-91b5-02ac2450be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b98f1b-4eac-421a-9184-01ef34c033ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27b98f1b-4eac-421a-9184-01ef34c033ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51eabac3-1955-446f-9ab2-731d3b271252', 'volume_name': 'volume-51eabac3-1955-446f-9ab2-731d3b271252', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad97f61-a083-4e4d-85be-432ad9c82b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad97f61-a083-4e4d-85be-432ad9c82b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977d1a54-9da4-4e20-9351-5375f3b375c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Volume 51eabac3-1955-446f-9ab2-731d3b271252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51eabac3-1955-446f-9ab2-731d3b271252', 'volume_size': 1} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1171345499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51eabac3-1955-446f-9ab2-731d3b271252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b0f28a1f046483ba586b94ce26636f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:10:30Z,use_quota=True,user_id='fd5fae121dc943558262bf8f814ccbef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Creating volume 51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:10:30 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:10:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:30 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 1073741824 Sep 28 15:10:30 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 1073741824" returned: 0 in 0.832s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:31 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 Sep 28 15:10:31 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:31 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.082s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Creating offline snapshot 0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 of volume f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977d1a54-9da4-4e20-9351-5375f3b375c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51eabac3-1955-446f-9ab2-731d3b271252', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aab64b0-25c6-4ccf-a089-30df22962ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[954383f2-9d2d-4bc2-874f-404453614550]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:31 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Volume volume-51eabac3-1955-446f-9ab2-731d3b271252 (51eabac3-1955-446f-9ab2-731d3b271252): created successfully Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aab64b0-25c6-4ccf-a089-30df22962ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:10:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Flow 'volume_create_manager' (9bcaabe0-45dc-4252-93ae-61a104f2ab91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:10:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d602c359-ebd5-4b25-9cd8-a35c5ef9eb57 tempest-SnapshotMetadataTestJSON-1507383164 None] Created volume successfully. Sep 28 15:10:31 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d Sep 28 15:10:31 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:32 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" returned: 0 in 0.678s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e8bf0a-5d42-4b02-94f6-16c478213322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:32 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 1G Sep 28 15:10:32 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:33 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 1G" returned: 0 in 0.876s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 Sep 28 15:10:33 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:33 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" returned: 0 in 0.576s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:33 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 is being set with open permissions: ugo+rw Sep 28 15:10:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:33 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 Sep 28 15:10:33 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:34 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" returned: 0 in 0.456s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.865s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Creating offline snapshot 16aa99e5-b16e-43b7-901f-c7fdefaa75e2 of volume 51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-47eed27c-ec09-465f-b43e-72f26c67da2f tempest-VolumesSnapshotListTestJSON-2037124372 None] Create snapshot completed successfully Sep 28 15:10:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[300c599a-7a97-445a-8d08-46cc82af846b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:34 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 Sep 28 15:10:34 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:35 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252" returned: 0 in 0.875s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:35 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 1G Sep 28 15:10:35 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:36 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 1G" returned: 0 in 0.883s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51eabac3-1955-446f-9ab2-731d3b271252 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:36 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51eabac3-1955-446f-9ab2-731d3b271252 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 Sep 28 15:10:36 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-17088287-928e-4e16-b78c-1cd0cfeb3734 req-bde37ef3-5251-4094-be1b-ec928413c0b3 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:36 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51eabac3-1955-446f-9ab2-731d3b271252 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2" returned: 0 in 0.566s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:36 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 is being set with open permissions: ugo+rw Sep 28 15:10:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:36 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 Sep 28 15:10:36 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2" returned: 0 in 0.388s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.info Sep 28 15:10:37 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:37 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.info" returned: 0 in 0.635s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:37 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.info is being set with open permissions: ugo+rw Sep 28 15:10:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:37 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.info Sep 28 15:10:37 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:38 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.info" returned: 0 in 0.350s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.910s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.908s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Creating offline snapshot 039747f5-aae5-4063-bf61-22c797f19523 of volume f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:10:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9210517d-a7c8-4533-a380-002a36a1bb79 tempest-SnapshotMetadataTestJSON-1507383164 None] Create snapshot completed successfully Sep 28 15:10:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9804047-ddc4-471e-a619-9c0b4109dd96]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:38 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 Sep 28 15:10:38 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:39 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" returned: 0 in 0.761s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e8bf0a-5d42-4b02-94f6-16c478213322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:39 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 1G Sep 28 15:10:39 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 1G" returned: 0 in 0.876s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 Sep 28 15:10:40 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:40 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523" returned: 0 in 0.609s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:40 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 is being set with open permissions: ugo+rw Sep 28 15:10:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:40 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 Sep 28 15:10:40 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:41 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523" returned: 0 in 0.496s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-17088287-928e-4e16-b78c-1cd0cfeb3734 req-bde37ef3-5251-4094-be1b-ec928413c0b3 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.601s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "cinder-16aa99e5-b16e-43b7-901f-c7fdefaa75e2-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-17088287-928e-4e16-b78c-1cd0cfeb3734 req-bde37ef3-5251-4094-be1b-ec928413c0b3 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-16aa99e5-b16e-43b7-901f-c7fdefaa75e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "cinder-quobyte-51eabac3-1955-446f-9ab2-731d3b271252" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f6788740-8ed5-42b4-b392-3fe55f39507e tempest-VolumesSnapshotListTestJSON-2037124372 None] Create snapshot completed successfully Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-quobyte-51eabac3-1955-446f-9ab2-731d3b271252" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "cinder-quobyte-16aa99e5-b16e-43b7-901f-c7fdefaa75e2" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-quobyte-16aa99e5-b16e-43b7-901f-c7fdefaa75e2" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Deleting offline snapshot 16aa99e5-b16e-43b7-901f-c7fdefaa75e2 of volume 51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] snapshot_file for this snap is: volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-17088287-928e-4e16-b78c-1cd0cfeb3734 req-bde37ef3-5251-4094-be1b-ec928413c0b3 tempest-TestInstancesWithCinderVolumes-253577244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-9519ef96-bc0c-4af1-87c3-69830b752eb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c356b308-2fa8-415e-a598-03e89bb4dd1d', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be4dd3f-5a53-4155-9223-7ddb0a6f2ba2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:41 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 Sep 28 15:10:41 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-17088287-928e-4e16-b78c-1cd0cfeb3734 req-bde37ef3-5251-4094-be1b-ec928413c0b3 tempest-TestInstancesWithCinderVolumes-253577244 None] attachment_update completed successfully. Sep 28 15:10:42 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2" returned: 0 in 0.970s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51eabac3-1955-446f-9ab2-731d3b271252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:42 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6408b12-05f3-4768-84ac-99f3b91aa1f9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:42 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 Sep 28 15:10:42 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252" returned: 0 in 0.858s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:43 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:43 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 Sep 28 15:10:43 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:44 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2" returned: 0 in 1.163s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:44 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2 Sep 28 15:10:44 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-039747f5-aae5-4063-bf61-22c797f19523-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-039747f5-aae5-4063-bf61-22c797f19523-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" acquired by "delete_snapshot" :: waited 0.093s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-quobyte-039747f5-aae5-4063-bf61-22c797f19523" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-039747f5-aae5-4063-bf61-22c797f19523" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Deleting offline snapshot 039747f5-aae5-4063-bf61-22c797f19523 of volume f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] snapshot_file for this snap is: volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f84df4-94aa-43f1-9c4c-2efe7ed7b7f9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:45 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252.16aa99e5-b16e-43b7-901f-c7fdefaa75e2" returned: 0 in 0.824s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:45 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 Sep 28 15:10:45 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-quobyte-16aa99e5-b16e-43b7-901f-c7fdefaa75e2" released by "_delete_snapshot" :: held 4.127s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-quobyte-51eabac3-1955-446f-9ab2-731d3b271252" released by "delete_snapshot" :: held 4.206s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Created reservations ['bd06234c-ad76-4aa9-af2c-bf78b0141fc9', 'feb0fdf0-73f2-4c9f-8825-c7eb1921419a', '003e5b02-1414-464d-9dd7-18a79f6ea17c', 'd4f8328c-a56f-44db-94c1-77122dc18191'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Delete snapshot completed successfully. Sep 28 15:10:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bfb66b34-9a28-44e2-852f-d98f82a74d8c tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-16aa99e5-b16e-43b7-901f-c7fdefaa75e2-delete_snapshot" released by "delete_snapshot" :: held 4.640s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:46 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523" returned: 0 in 0.766s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e8bf0a-5d42-4b02-94f6-16c478213322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:46 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0897cc9-106c-43b5-a0b2-254e35c2fdf5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:46 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 Sep 28 15:10:46 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "cinder-51eabac3-1955-446f-9ab2-731d3b271252-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:46 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-51eabac3-1955-446f-9ab2-731d3b271252-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" returned: 0 in 0.959s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e8bf0a-5d42-4b02-94f6-16c478213322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 Sep 28 15:10:47 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "cinder-quobyte-51eabac3-1955-446f-9ab2-731d3b271252" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-quobyte-51eabac3-1955-446f-9ab2-731d3b271252" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[36302332-3cd7-49fd-936c-b004bad295c5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:47 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:10:47 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:47 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 Sep 28 15:10:47 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:48 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252" returned: 0 in 0.840s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:48 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252 Sep 28 15:10:48 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:48 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 1.091s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:48 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523" returned: 0 in 1.365s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:48 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523 Sep 28 15:10:48 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:48 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51eabac3-1955-446f-9ab2-731d3b271252" returned: 0 in 0.835s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-quobyte-51eabac3-1955-446f-9ab2-731d3b271252" released by "delete_volume" :: held 1.921s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:49 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.039747f5-aae5-4063-bf61-22c797f19523" returned: 0 in 0.795s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-039747f5-aae5-4063-bf61-22c797f19523" released by "_delete_snapshot" :: held 4.121s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" released by "delete_snapshot" :: held 4.206s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Created reservations ['e6b47685-05b9-47c7-aacc-c5230d55fcdb', '60419590-09d4-4224-8e44-0ed8feb26ebb', '123dc01b-098a-4c35-a078-b2ce7c9d35e0', '833206dd-5c89-4100-b1d1-eab37d6ade81'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Created reservations ['294ba5f9-41cd-4522-986e-5b2cd4b7821b', '1a3016be-4bf3-483b-b6c6-c1cdf45e025c', '56444f4a-b855-4379-8608-8a2fd2f3cad3', 'cb524e75-ed52-4b50-a579-3a04e1c4c5e4'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:49 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:10:49 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Delete snapshot completed successfully. Sep 28 15:10:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c72fe1e5-c998-4fbf-8c54-37c6cfa326df tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-039747f5-aae5-4063-bf61-22c797f19523-delete_snapshot" released by "delete_snapshot" :: held 4.848s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:50 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.593s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:10:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Deleted volume successfully. Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4ead8fd4-4aa8-41df-97ae-f13f1fa42fae tempest-SnapshotMetadataTestJSON-1507383164 None] Lock "cinder-51eabac3-1955-446f-9ab2-731d3b271252-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-0775f8e0-0bd8-42b6-a08c-05c1aaf179d1-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-0775f8e0-0bd8-42b6-a08c-05c1aaf179d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-quobyte-0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" acquired by "_delete_snapshot" :: waited 0.069s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Deleting offline snapshot 0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 of volume f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] snapshot_file for this snap is: volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2efffe-c041-49ff-bd30-95802a1bb580]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:51 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 Sep 28 15:10:51 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:52 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" returned: 0 in 1.259s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e8bf0a-5d42-4b02-94f6-16c478213322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:52 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af7fec1-37e4-4470-a0f4-e13cf150b5ff]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:52 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d Sep 28 15:10:52 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:53 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" returned: 0 in 1.072s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e8bf0a-5d42-4b02-94f6-16c478213322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:53 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 Sep 28 15:10:53 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:54 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" returned: 0 in 1.449s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:54 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1 Sep 28 15:10:54 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:55 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" returned: 0 in 0.929s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-0775f8e0-0bd8-42b6-a08c-05c1aaf179d1" released by "_delete_snapshot" :: held 5.161s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" released by "delete_snapshot" :: held 5.249s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Created reservations ['6fe48f8a-6acc-4a05-b903-6b5a85e7ffd2', '06f07f80-9914-447f-891c-f08c0006fcb9', 'b32ce9a1-2e2e-4d7d-98a5-24aee276a99d', '4a57fc2c-43dd-486e-988d-83a1bef4cfb6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:10:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Delete snapshot completed successfully. Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4c0b90aa-b663-4a4d-8cc8-2b92f9d4712d tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-0775f8e0-0bd8-42b6-a08c-05c1aaf179d1-delete_snapshot" released by "delete_snapshot" :: held 5.707s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" acquired by "delete_snapshot" :: waited 0.260s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-quobyte-8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" acquired by "_delete_snapshot" :: waited 0.083s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Deleting offline snapshot 8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d of volume f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:10:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] snapshot_file for this snap is: volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:10:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d186bcd-970f-4417-b41d-58b7a805e9e4]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:57 devstack sudo[96166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d Sep 28 15:10:57 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:57 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" returned: 0 in 0.894s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e8bf0a-5d42-4b02-94f6-16c478213322(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:10:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ce8e3-925b-4a13-897d-83d4da45991d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:10:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:58 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 Sep 28 15:10:58 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:58 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322" returned: 0 in 0.929s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:59 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d Sep 28 15:10:59 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:10:59 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 28 15:10:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" returned: 0 in 0.900s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:10:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:10:59 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d Sep 28 15:10:59 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:00 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322.8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" returned: 0 in 0.563s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d" released by "_delete_snapshot" :: held 3.709s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" released by "delete_snapshot" :: held 3.833s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:00 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Created reservations ['e3a47e46-8668-49dd-96ca-58b62b4e9d2d', 'ed40b560-4af5-412b-a039-e31bf307a876', '7c062c88-955c-42a1-a5e2-0222bccd4c52', '9282f7c7-3ffb-4f65-81ce-be35e994acc2'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:01 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Delete snapshot completed successfully. Sep 28 15:11:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06d858fb-e719-4895-a309-72c207ce3c41 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-8f190c2e-483b-4a8c-8b6f-cbdeb6e6286d-delete_snapshot" released by "delete_snapshot" :: held 4.506s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-f0e8bf0a-5d42-4b02-94f6-16c478213322-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-f0e8bf0a-5d42-4b02-94f6-16c478213322-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:01 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4c5d5b-afd7-4e26-9f24-f7a7ca8d9539]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:02 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 Sep 28 15:11:02 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:03 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322" returned: 0 in 1.906s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:03 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322 Sep 28 15:11:03 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:04 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0e8bf0a-5d42-4b02-94f6-16c478213322" returned: 0 in 1.139s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-quobyte-f0e8bf0a-5d42-4b02-94f6-16c478213322" released by "delete_volume" :: held 3.218s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:04 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Created reservations ['4bf1876e-ac31-4299-b5e0-09ea46fc7448', '16aa4ffc-84a7-45ce-8098-75230c127a57', 'c580dda7-0ab9-49b7-8687-c5be186ed8c4', '9f22e24c-d8a6-4241-9594-827ac8e132a0'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Flow 'volume_create_manager' (a6bbd0fd-dea2-4e5c-9a5e-b7eb610e180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e19722-a2da-4064-a2e3-4b4eb90de773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:05 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:11:05 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56e19722-a2da-4064-a2e3-4b4eb90de773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1549146614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e2d149-1498-4bce-ae59-7675553d4676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e87b2f513947c99d688c69d42fccc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:05Z,use_quota=True,user_id='3be5a9a2cfe14337a1e67a42bcfb12ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9615f4c-68d2-47bc-b30b-c275d1c401a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9615f4c-68d2-47bc-b30b-c275d1c401a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65251d0-a16a-4b65-9a78-74af1e7e1b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65251d0-a16a-4b65-9a78-74af1e7e1b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e2d149-1498-4bce-ae59-7675553d4676', 'volume_name': 'volume-43e2d149-1498-4bce-ae59-7675553d4676', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be02797-85d1-41f2-8623-ac45ebd2d4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6be02797-85d1-41f2-8623-ac45ebd2d4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc55275-75ae-42f6-8664-fcf1aba94e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:05 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Volume 43e2d149-1498-4bce-ae59-7675553d4676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e2d149-1498-4bce-ae59-7675553d4676', 'volume_size': 1} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1549146614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e2d149-1498-4bce-ae59-7675553d4676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e87b2f513947c99d688c69d42fccc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:05Z,use_quota=True,user_id='3be5a9a2cfe14337a1e67a42bcfb12ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Creating volume 43e2d149-1498-4bce-ae59-7675553d4676 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:05 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:11:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:05 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 1073741824 Sep 28 15:11:05 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:06 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.894s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:06 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Deleted volume successfully. Sep 28 15:11:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-286bce8b-d7c9-4b91-a064-cb6a1b043148 tempest-VolumesSnapshotListTestJSON-2037124372 None] Lock "cinder-f0e8bf0a-5d42-4b02-94f6-16c478213322-delete_volume" released by "delete_volume" :: held 4.884s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:07 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 1073741824" returned: 0 in 1.689s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:07 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 Sep 28 15:11:07 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:08 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676" returned: 0 in 0.841s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] <== create_volume: return (2738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.756s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc55275-75ae-42f6-8664-fcf1aba94e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e2d149-1498-4bce-ae59-7675553d4676', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dab6c1d-73b5-4dad-acde-bd046814dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Volume volume-43e2d149-1498-4bce-ae59-7675553d4676 (43e2d149-1498-4bce-ae59-7675553d4676): created successfully Sep 28 15:11:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dab6c1d-73b5-4dad-acde-bd046814dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Flow 'volume_create_manager' (a6bbd0fd-dea2-4e5c-9a5e-b7eb610e180b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:08 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cd8d1e46-673f-4984-9581-febb9e65e38e tempest-VolumesMetadataTest-1090257205 None] Created volume successfully. Sep 28 15:11:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Acquiring lock "cinder-43e2d149-1498-4bce-ae59-7675553d4676-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Lock "cinder-43e2d149-1498-4bce-ae59-7675553d4676-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Acquiring lock "cinder-quobyte-43e2d149-1498-4bce-ae59-7675553d4676" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Lock "cinder-quobyte-43e2d149-1498-4bce-ae59-7675553d4676" acquired by "delete_volume" :: waited 0.061s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:12 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ebbda-9153-4046-9889-2fa880eef241]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:12 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 Sep 28 15:11:12 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:13 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676" returned: 0 in 0.677s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:13 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676 Sep 28 15:11:13 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:13 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-43e2d149-1498-4bce-ae59-7675553d4676" returned: 0 in 0.376s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Lock "cinder-quobyte-43e2d149-1498-4bce-ae59-7675553d4676" released by "delete_volume" :: held 1.153s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:13 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Created reservations ['2d08d38b-5aa0-4991-bfb1-857751fd5301', '1b2b126f-8599-40fa-b7f4-bc0cfbd98f70', '93621e4a-98a4-4b9f-8265-0cf21d04493d', '4b493e38-79d3-4fe0-854c-3681534486c7'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:14 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:11:14 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:14 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.364s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Deleted volume successfully. Sep 28 15:11:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8deb264-885e-47e8-92e4-39ff6426d6e8 tempest-VolumesMetadataTest-1090257205 None] Lock "cinder-43e2d149-1498-4bce-ae59-7675553d4676-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=73,cinder:UPDATE=67,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=58,cinder:INSERT=19,cinder:UPDATE=65,cinder:DELETE=6 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Flow 'volume_create_manager' (45b86429-a569-4e42-a02b-8fcdbeec5eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec81a155-a80c-4eee-a2b3-e6e44c6a512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec81a155-a80c-4eee-a2b3-e6e44c6a512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-26974044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f38c223-7931-45d5-a240-641e5066485d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b040f6fa640da8e4536575e3d7be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:23Z,use_quota=True,user_id='3944ef8e99fd43579214333a8feaed76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e3dac-a84d-41ef-8305-e53334ba9e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60e3dac-a84d-41ef-8305-e53334ba9e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3d367d-3dc5-4fa7-acec-d8d7ba3519c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3d367d-3dc5-4fa7-acec-d8d7ba3519c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f38c223-7931-45d5-a240-641e5066485d', 'volume_name': 'volume-3f38c223-7931-45d5-a240-641e5066485d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4449b62c-de06-453e-9372-699326a0882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4449b62c-de06-453e-9372-699326a0882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24cbb20-9a01-4757-b990-485647806590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Volume 3f38c223-7931-45d5-a240-641e5066485d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f38c223-7931-45d5-a240-641e5066485d', 'volume_size': 1} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-26974044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f38c223-7931-45d5-a240-641e5066485d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b040f6fa640da8e4536575e3d7be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:23Z,use_quota=True,user_id='3944ef8e99fd43579214333a8feaed76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Creating volume 3f38c223-7931-45d5-a240-641e5066485d {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:23 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d 1073741824 Sep 28 15:11:23 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Flow 'volume_create_manager' (5ebad7aa-ea7c-40e1-9a99-2412df0db55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467da987-9460-44b7-87a3-eff79ce335b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467da987-9460-44b7-87a3-eff79ce335b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1038379911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8464ce7c-ea2d-491a-a90f-2301acf605e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44542fe4e387426aad516e3a25cf7271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:24Z,use_quota=True,user_id='40dbc15c605b47daa68438a749310b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4f8623-97e5-4476-b525-7d12a6acc8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4f8623-97e5-4476-b525-7d12a6acc8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0662cc-d987-49d7-b8e8-10b597ae4532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0662cc-d987-49d7-b8e8-10b597ae4532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8464ce7c-ea2d-491a-a90f-2301acf605e1', 'volume_name': 'volume-8464ce7c-ea2d-491a-a90f-2301acf605e1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fff609-fa0d-4685-b906-8728463d8b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fff609-fa0d-4685-b906-8728463d8b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39608585-c154-42ed-bf8f-ba753fc18cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Volume 8464ce7c-ea2d-491a-a90f-2301acf605e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8464ce7c-ea2d-491a-a90f-2301acf605e1', 'volume_size': 1} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:24 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d 1073741824" returned: 0 in 1.009s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:24 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d Sep 28 15:11:24 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d" returned: 0 in 0.637s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1038379911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8464ce7c-ea2d-491a-a90f-2301acf605e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44542fe4e387426aad516e3a25cf7271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:24Z,use_quota=True,user_id='40dbc15c605b47daa68438a749310b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Creating volume 8464ce7c-ea2d-491a-a90f-2301acf605e1 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:25 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24cbb20-9a01-4757-b990-485647806590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f38c223-7931-45d5-a240-641e5066485d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 1073741824 Sep 28 15:11:25 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1559d7-58d2-4cf2-994d-3245b26c6c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:25 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Volume volume-3f38c223-7931-45d5-a240-641e5066485d (3f38c223-7931-45d5-a240-641e5066485d): created successfully Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1559d7-58d2-4cf2-994d-3245b26c6c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Flow 'volume_create_manager' (45b86429-a569-4e42-a02b-8fcdbeec5eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a5905f9a-27b3-470e-8f52-4735860a1205 tempest-AttachVolumeShelveTestJSON-1943783342 None] Created volume successfully. Sep 28 15:11:25 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 1073741824" returned: 0 in 0.901s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:26 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 Sep 28 15:11:26 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:26 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1" returned: 0 in 0.438s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39608585-c154-42ed-bf8f-ba753fc18cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8464ce7c-ea2d-491a-a90f-2301acf605e1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2402742b-7f3e-4a5e-8de2-3089b45ec680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:26 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Volume volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 (8464ce7c-ea2d-491a-a90f-2301acf605e1): created successfully Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2402742b-7f3e-4a5e-8de2-3089b45ec680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Flow 'volume_create_manager' (5ebad7aa-ea7c-40e1-9a99-2412df0db55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dbb99135-8ea0-4a80-84e6-7a128f730058 tempest-VolumesTransfersV357Test-559650192 None] Created volume successfully. Sep 28 15:11:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-0e9bba5a-d73b-40e2-9798-1a8acead1dcf req-0fb95aac-5d42-4f0a-be7e-78e6e03f6dc1 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-0e9bba5a-d73b-40e2-9798-1a8acead1dcf req-0fb95aac-5d42-4f0a-be7e-78e6e03f6dc1 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-0e9bba5a-d73b-40e2-9798-1a8acead1dcf req-0fb95aac-5d42-4f0a-be7e-78e6e03f6dc1 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-0e9bba5a-d73b-40e2-9798-1a8acead1dcf req-0fb95aac-5d42-4f0a-be7e-78e6e03f6dc1 tempest-TestInstancesWithCinderVolumes-253577244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-29635e52-05a4-468d-b88f-0e1b5cc0b992', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f5306e2-8d1a-42e9-8d00-d28fd35e4af5', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:11:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-0e9bba5a-d73b-40e2-9798-1a8acead1dcf req-0fb95aac-5d42-4f0a-be7e-78e6e03f6dc1 tempest-TestInstancesWithCinderVolumes-253577244 None] attachment_update completed successfully. Sep 28 15:11:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1bd297c7-6c59-4a74-a6ad-f60f5fe1d340 tempest-VolumesTransfersV357Test-391474372 None] Transfer volume completed successfully. Sep 28 15:11:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Acquiring lock "cinder-8464ce7c-ea2d-491a-a90f-2301acf605e1-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-8464ce7c-ea2d-491a-a90f-2301acf605e1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Acquiring lock "cinder-quobyte-8464ce7c-ea2d-491a-a90f-2301acf605e1" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-quobyte-8464ce7c-ea2d-491a-a90f-2301acf605e1" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:30 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8456ea10-9f55-46a8-b75e-317d8e035caf]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:30 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 Sep 28 15:11:30 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:31 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1" returned: 0 in 1.037s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:31 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1 Sep 28 15:11:31 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:31 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8464ce7c-ea2d-491a-a90f-2301acf605e1" returned: 0 in 0.523s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-f20dfa63-d3a6-407e-94b8-c82c7e86195e req-26119552-1c8b-4852-bc06-135c0890a787 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-f20dfa63-d3a6-407e-94b8-c82c7e86195e req-26119552-1c8b-4852-bc06-135c0890a787 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-quobyte-8464ce7c-ea2d-491a-a90f-2301acf605e1" released by "delete_volume" :: held 1.700s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-f20dfa63-d3a6-407e-94b8-c82c7e86195e req-26119552-1c8b-4852-bc06-135c0890a787 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-f20dfa63-d3a6-407e-94b8-c82c7e86195e req-26119552-1c8b-4852-bc06-135c0890a787 tempest-TestInstancesWithCinderVolumes-253577244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53150ea6-233f-4cfe-8aef-54cafa637ce5', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Created reservations ['06fbbec2-4a7b-4e79-9122-bf843ae1d821', 'e24fa55f-5235-404a-bfac-430c7d6b52a0', '4b11e0b9-4c24-4cc9-bb70-8ca288c303d2', 'abd9c9e7-686c-44a8-8320-fa968ebe86e6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:32 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-f20dfa63-d3a6-407e-94b8-c82c7e86195e req-26119552-1c8b-4852-bc06-135c0890a787 tempest-TestInstancesWithCinderVolumes-253577244 None] attachment_update completed successfully. Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:32 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:11:32 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:33 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.828s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Deleted volume successfully. Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5899f58d-8b62-4feb-84f9-f57666ca8f3d tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-8464ce7c-ea2d-491a-a90f-2301acf605e1-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Flow 'volume_create_manager' (399acffa-d5a8-4b9e-b75b-a1a56eadcb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ebcfde-0043-4d9d-944b-b623bf9f4455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67ebcfde-0043-4d9d-944b-b623bf9f4455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1403772782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c17b963-5819-44ee-8dfa-80b1b904b6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44542fe4e387426aad516e3a25cf7271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:34Z,use_quota=True,user_id='40dbc15c605b47daa68438a749310b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f823034d-a601-4f7f-bef3-b9c4aa76feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f823034d-a601-4f7f-bef3-b9c4aa76feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492119f4-d233-4ec2-abe4-0b0aaa032945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (492119f4-d233-4ec2-abe4-0b0aaa032945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c17b963-5819-44ee-8dfa-80b1b904b6fb', 'volume_name': 'volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbe59f5-9cc6-4bb7-9314-3c56d9b8007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adbe59f5-9cc6-4bb7-9314-3c56d9b8007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62033ea2-1162-449d-a7e1-70bd300f1e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:33 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Volume 7c17b963-5819-44ee-8dfa-80b1b904b6fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb', 'volume_size': 1} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1403772782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c17b963-5819-44ee-8dfa-80b1b904b6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44542fe4e387426aad516e3a25cf7271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:11:34Z,use_quota=True,user_id='40dbc15c605b47daa68438a749310b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Creating volume 7c17b963-5819-44ee-8dfa-80b1b904b6fb {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:11:33 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:11:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb 1073741824 Sep 28 15:11:34 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:34 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb 1073741824" returned: 0 in 0.883s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:34 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb Sep 28 15:11:34 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:35 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb" returned: 0 in 0.390s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:11:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62033ea2-1162-449d-a7e1-70bd300f1e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce72dad-4b49-4729-af40-abcfa7ceff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:11:35 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Volume volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb (7c17b963-5819-44ee-8dfa-80b1b904b6fb): created successfully Sep 28 15:11:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce72dad-4b49-4729-af40-abcfa7ceff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:11:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Flow 'volume_create_manager' (399acffa-d5a8-4b9e-b75b-a1a56eadcb49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:11:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8385fbdd-1fb3-4bf3-acaa-d7ebc54fe2dd tempest-VolumesTransfersV357Test-559650192 None] Created volume successfully. Sep 28 15:11:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Acquiring lock "cinder-7c17b963-5819-44ee-8dfa-80b1b904b6fb-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-7c17b963-5819-44ee-8dfa-80b1b904b6fb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Acquiring lock "cinder-quobyte-7c17b963-5819-44ee-8dfa-80b1b904b6fb" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-quobyte-7c17b963-5819-44ee-8dfa-80b1b904b6fb" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:37 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba368d0-11ad-4c4d-8619-9365b11f7594]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:37 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb Sep 28 15:11:37 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:37 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb" returned: 0 in 0.708s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:37 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb Sep 28 15:11:37 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:38 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7c17b963-5819-44ee-8dfa-80b1b904b6fb" returned: 0 in 0.490s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-quobyte-7c17b963-5819-44ee-8dfa-80b1b904b6fb" released by "delete_volume" :: held 1.280s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Created reservations ['7388c061-6812-4441-a9e0-0e8e15d2bae9', '9cbc8ce6-d1d2-4c80-979c-81fb69c6fef2', '45c501a8-5deb-441d-b40a-47deb2a2b474', '7f0502cb-eb8c-4b82-b569-3d3c45a4db25'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:38 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:11:38 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:39 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.445s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:39 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Deleted volume successfully. Sep 28 15:11:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4706c11a-0b40-482d-97f1-6cd5d8fe82dc tempest-VolumesTransfersV357Test-1987861943 None] Lock "cinder-7c17b963-5819-44ee-8dfa-80b1b904b6fb-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:40 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-d49f6317-d2e3-4b48-882b-89cf91c38849 req-4488ff4e-beb7-45fc-895a-506ec4b66f0e tempest-TestInstancesWithCinderVolumes-253577244 None] Terminate volume connection completed successfully. Sep 28 15:11:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-d49f6317-d2e3-4b48-882b-89cf91c38849 req-4488ff4e-beb7-45fc-895a-506ec4b66f0e tempest-TestInstancesWithCinderVolumes-253577244 None] Deleting attachment 5f5306e2-8d1a-42e9-8d00-d28fd35e4af5. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:11:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "cinder-29635e52-05a4-468d-b88f-0e1b5cc0b992-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-29635e52-05a4-468d-b88f-0e1b5cc0b992-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "cinder-quobyte-29635e52-05a4-468d-b88f-0e1b5cc0b992" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-quobyte-29635e52-05a4-468d-b88f-0e1b5cc0b992" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:42 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[998096dc-d20c-4f8f-b8fc-52a18f7b0a4f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:42 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 Sep 28 15:11:42 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:43 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992" returned: 0 in 0.993s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:43 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992 Sep 28 15:11:43 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-88fcdff0-0e30-40fa-84c6-02b83029c5d3 req-cf85da4e-0da6-42e6-82cb-4019071e0e25 tempest-AttachVolumeShelveTestJSON-1943783342 None] No connector for attachment 373df3b9-b0e6-4852-bb33-f355f785356a; skipping storage backend terminate_connection call. {{(pid=86301) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-88fcdff0-0e30-40fa-84c6-02b83029c5d3 req-cf85da4e-0da6-42e6-82cb-4019071e0e25 tempest-AttachVolumeShelveTestJSON-1943783342 None] Deleting attachment 373df3b9-b0e6-4852-bb33-f355f785356a. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:11:44 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-29635e52-05a4-468d-b88f-0e1b5cc0b992" returned: 0 in 0.650s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-quobyte-29635e52-05a4-468d-b88f-0e1b5cc0b992" released by "delete_volume" :: held 1.741s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:44 devstack cinder-volume[86301]: WARNING cinder.quota [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-837224267-2037652037 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-837224267-2037652037, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:11:44 devstack cinder-volume[86301]: WARNING cinder.quota [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-837224267-2037652037 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-837224267-2037652037, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Created reservations ['b9662cbd-2b23-43a0-981f-976dc1d5cd56', 'd057c0fd-d099-42a9-bd96-fbf6e985f595', 'e9eba76e-318f-4d6a-b3a0-a317ad8c2432', '05998cf4-8a7a-483c-8284-b0e09b4faf50'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:44 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:11:44 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:45 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.531s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:45 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Deleted volume successfully. Sep 28 15:11:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ab8d6a1c-c094-4541-9bed-4207dc0f97bc tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-29635e52-05a4-468d-b88f-0e1b5cc0b992-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:47 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:11:47 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:47 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.450s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:11:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:11:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-527cb38b-ef65-4c94-b584-3254066180ea req-cffb6998-4658-4774-91c8-e98e6bfc54bf tempest-TestInstancesWithCinderVolumes-253577244 None] Terminate volume connection completed successfully. Sep 28 15:11:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-527cb38b-ef65-4c94-b584-3254066180ea req-cffb6998-4658-4774-91c8-e98e6bfc54bf tempest-TestInstancesWithCinderVolumes-253577244 None] Deleting attachment 53150ea6-233f-4cfe-8aef-54cafa637ce5. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:11:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "cinder-9cda7ae2-1034-4650-8777-c3bcf2822a8b-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-9cda7ae2-1034-4650-8777-c3bcf2822a8b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "cinder-quobyte-9cda7ae2-1034-4650-8777-c3bcf2822a8b" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:11:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-quobyte-9cda7ae2-1034-4650-8777-c3bcf2822a8b" acquired by "delete_volume" :: waited 0.068s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:11:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[686c1268-e46f-4f78-8425-a504fda82f3c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:11:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:50 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b Sep 28 15:11:50 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:50 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b" returned: 0 in 0.809s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:50 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b Sep 28 15:11:50 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:51 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9cda7ae2-1034-4650-8777-c3bcf2822a8b" returned: 0 in 0.524s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-quobyte-9cda7ae2-1034-4650-8777-c3bcf2822a8b" released by "delete_volume" :: held 1.491s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:11:51 devstack cinder-volume[86301]: WARNING cinder.quota [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823308126-1870900923 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823308126-1870900923, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:11:51 devstack cinder-volume[86301]: WARNING cinder.quota [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823308126-1870900923 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-823308126-1870900923, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Created reservations ['4e323f06-6773-437c-8bcb-c7c3ac611fad', '00d86bd7-9021-4828-b222-313e7547640e', '1a17a324-212e-4fb9-9714-1c2d127967c8', '68766910-e648-407f-af38-a69b081f7d36'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:11:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:11:51 devstack sudo[96565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:11:51 devstack sudo[96565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:11:52 devstack sudo[96565]: pam_unix(sudo:session): session closed for user root Sep 28 15:11:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:11:52 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:11:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Deleted volume successfully. Sep 28 15:11:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fe2b694-5a3e-424e-87cf-c7dc180979e0 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-9cda7ae2-1034-4650-8777-c3bcf2822a8b-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:01 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=44,cinder:SELECT=39,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:02 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=45,cinder:INSERT=9,cinder:UPDATE=43,cinder:DELETE=4 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Flow 'volume_create_manager' (bca1351f-d2a6-4d90-aaff-fa07a5f6ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef08e329-5fce-4b7b-9a57-0966995fb02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef08e329-5fce-4b7b-9a57-0966995fb02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1497521901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143b65a9-e634-4928-a708-da8ffc22a83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ec14966fb4296973a2601363c47aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:06Z,use_quota=True,user_id='f5aadcf3160b4200a0a1139da1871918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c46319d-c8e0-4290-8c26-37df3fcdf702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c46319d-c8e0-4290-8c26-37df3fcdf702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f954f451-035d-497e-867a-79dbd828d7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f954f451-035d-497e-867a-79dbd828d7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143b65a9-e634-4928-a708-da8ffc22a83e', 'volume_name': 'volume-143b65a9-e634-4928-a708-da8ffc22a83e', 'volume_size': 2}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d932b9-f4ee-4fde-9955-cdeef498f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d932b9-f4ee-4fde-9955-cdeef498f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca542fd7-a9cf-4738-bf33-63e88bcaa170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:06 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Volume 143b65a9-e634-4928-a708-da8ffc22a83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143b65a9-e634-4928-a708-da8ffc22a83e', 'volume_size': 2} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1497521901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143b65a9-e634-4928-a708-da8ffc22a83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='299ec14966fb4296973a2601363c47aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:06Z,use_quota=True,user_id='f5aadcf3160b4200a0a1139da1871918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Creating volume 143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:06 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e 2147483648 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:06 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e 2147483648 Sep 28 15:12:06 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-c4f576ce-d11b-4e29-9b53-5ba07a25a40b req-92a56525-76e9-44ef-8aa3-c2081b43f5da tempest-TestInstancesWithCinderVolumes-253577244 None] Terminate volume connection completed successfully. Sep 28 15:12:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-c4f576ce-d11b-4e29-9b53-5ba07a25a40b req-92a56525-76e9-44ef-8aa3-c2081b43f5da tempest-TestInstancesWithCinderVolumes-253577244 None] Deleting attachment c356b308-2fa8-415e-a598-03e89bb4dd1d. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:12:07 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e 2147483648" returned: 0 in 0.864s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:07 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e Sep 28 15:12:07 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:07 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e" returned: 0 in 0.539s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca542fd7-a9cf-4738-bf33-63e88bcaa170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143b65a9-e634-4928-a708-da8ffc22a83e', 'volume_size': 2}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea9cde0-d7eb-4ac6-862a-4ab07486c8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "cinder-9519ef96-bc0c-4af1-87c3-69830b752eb6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Volume volume-143b65a9-e634-4928-a708-da8ffc22a83e (143b65a9-e634-4928-a708-da8ffc22a83e): created successfully Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea9cde0-d7eb-4ac6-862a-4ab07486c8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Flow 'volume_create_manager' (bca1351f-d2a6-4d90-aaff-fa07a5f6ba62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-9519ef96-bc0c-4af1-87c3-69830b752eb6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:08 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-695c7968-1d5b-4b97-ba06-6a08bf376d84 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Created volume successfully. Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "cinder-quobyte-9519ef96-bc0c-4af1-87c3-69830b752eb6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-quobyte-9519ef96-bc0c-4af1-87c3-69830b752eb6" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5cd757-9b4a-4286-97bd-8e7ec550e28d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:08 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 Sep 28 15:12:08 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:08 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6" returned: 0 in 0.697s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:09 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6 Sep 28 15:12:09 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Creating offline snapshot 72082072-c247-472f-8a10-7a7d047bf9d4 of volume 143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f56d1c-4920-426b-9668-78d72724e4e6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e Sep 28 15:12:09 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9519ef96-bc0c-4af1-87c3-69830b752eb6" returned: 0 in 0.527s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-quobyte-9519ef96-bc0c-4af1-87c3-69830b752eb6" released by "delete_volume" :: held 1.336s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:09 devstack cinder-volume[86301]: WARNING cinder.quota [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061693152-1394191044 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061693152-1394191044, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:12:09 devstack cinder-volume[86301]: WARNING cinder.quota [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061693152-1394191044 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061693152-1394191044, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Created reservations ['55bbf7d2-abcc-40d2-abc9-03320c4bd68a', '4abd7377-eb6c-48cd-8ad2-4c001d52e12a', '93b8e5cc-bc6d-4a21-9528-437ee40d396d', '8c5405cc-290b-4ad6-b153-c981351737b6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:12:09 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:09 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e" returned: 0 in 0.717s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 2G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:09 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 2G Sep 28 15:12:09 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:10 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.597s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:10 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Deleted volume successfully. Sep 28 15:12:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-e365a130-5a57-42b8-ad7e-f87ad3a60470 tempest-TestInstancesWithCinderVolumes-253577244 None] Lock "cinder-9519ef96-bc0c-4af1-87c3-69830b752eb6-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:10 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 2G" returned: 0 in 1.133s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143b65a9-e634-4928-a708-da8ffc22a83e -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:11 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143b65a9-e634-4928-a708-da8ffc22a83e -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 Sep 28 15:12:11 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:12 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-143b65a9-e634-4928-a708-da8ffc22a83e -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4" returned: 0 in 1.085s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:12 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 is being set with open permissions: ugo+rw Sep 28 15:12:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:12 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 Sep 28 15:12:12 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:12 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4" returned: 0 in 0.806s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:13 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.info Sep 28 15:12:13 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:13 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.info" returned: 0 in 0.595s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:13 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.info is being set with open permissions: ugo+rw Sep 28 15:12:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:13 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.info Sep 28 15:12:13 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:14 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.info" returned: 0 in 0.768s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.470s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8ed0d44c-0ec8-4aa3-89e8-a55b3b23a9b6 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Create snapshot completed successfully Sep 28 15:12:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "cinder-72082072-c247-472f-8a10-7a7d047bf9d4-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-72082072-c247-472f-8a10-7a7d047bf9d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "cinder-quobyte-143b65a9-e634-4928-a708-da8ffc22a83e" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-quobyte-143b65a9-e634-4928-a708-da8ffc22a83e" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "cinder-quobyte-72082072-c247-472f-8a10-7a7d047bf9d4" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-quobyte-72082072-c247-472f-8a10-7a7d047bf9d4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Deleting offline snapshot 72082072-c247-472f-8a10-7a7d047bf9d4 of volume 143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] snapshot_file for this snap is: volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[43137a14-c880-467c-8e0a-84da33c8d75a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:16 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 Sep 28 15:12:16 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:16 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4" returned: 0 in 0.743s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-143b65a9-e634-4928-a708-da8ffc22a83e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:12:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28b20d4-4675-47a0-8d67-3f3887c2a1bb]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:17 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e Sep 28 15:12:17 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:17 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e" returned: 0 in 0.949s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:18 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 Sep 28 15:12:18 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:18 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4" returned: 0 in 0.654s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:18 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4 Sep 28 15:12:18 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:19 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e.72082072-c247-472f-8a10-7a7d047bf9d4" returned: 0 in 0.818s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-quobyte-72082072-c247-472f-8a10-7a7d047bf9d4" released by "_delete_snapshot" :: held 3.480s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-quobyte-143b65a9-e634-4928-a708-da8ffc22a83e" released by "delete_snapshot" :: held 3.525s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:19 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Created reservations ['d4265444-bfc0-470f-b18c-1985e169ef10', '7dee962d-d2d5-4446-be82-d1aa727782cb', 'afb4a61c-8219-4aec-a8e3-1f01ca249f57', 'f3327e18-53db-4b18-b21e-e405636a3720'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Delete snapshot completed successfully. Sep 28 15:12:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c7a745f0-685f-48de-9d22-0951b1a12073 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-72082072-c247-472f-8a10-7a7d047bf9d4-delete_snapshot" released by "delete_snapshot" :: held 3.999s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "cinder-143b65a9-e634-4928-a708-da8ffc22a83e-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-143b65a9-e634-4928-a708-da8ffc22a83e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "cinder-quobyte-143b65a9-e634-4928-a708-da8ffc22a83e" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-quobyte-143b65a9-e634-4928-a708-da8ffc22a83e" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:21 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ca5f49-8e07-4679-802e-7ce044c34ccf]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:21 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e Sep 28 15:12:21 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e" returned: 0 in 0.974s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:22 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e Sep 28 15:12:22 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:22 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-143b65a9-e634-4928-a708-da8ffc22a83e" returned: 0 in 0.742s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-quobyte-143b65a9-e634-4928-a708-da8ffc22a83e" released by "delete_volume" :: held 1.851s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:22 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Created reservations ['d879d443-5ebd-4400-8945-284136aa561b', 'd5422869-ed29-4090-879d-b86f7cdecdd4', 'f6bb8b62-fd99-495f-8ed7-395992f18384', '3ece4284-d87a-4cd3-a229-39b3c6882003'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:23 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:12:23 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:24 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 1.222s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:24 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Deleted volume successfully. Sep 28 15:12:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-725a7e32-670a-4962-8549-d5755e0a7038 tempest-VolumesSnapshotNegativeTestJSON-1192641213 None] Lock "cinder-143b65a9-e634-4928-a708-da8ffc22a83e-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:25 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:12:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Flow 'volume_create_manager' (6eef9e93-d969-491e-8646-87b0b514c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:25 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30a335-2e97-4927-bbdf-c63cf84ab626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd30a335-2e97-4927-bbdf-c63cf84ab626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2140386960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eef083-7029-450e-8803-6e0251f0d846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29630b900eda4bac9688e8378c464846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:26Z,use_quota=True,user_id='f64b8105786f47bda7f51e6782c2ea1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17334927-648f-4e0e-b0d2-2136d567ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17334927-648f-4e0e-b0d2-2136d567ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff732293-88bd-460b-9689-ff4bc850a63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff732293-88bd-460b-9689-ff4bc850a63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37eef083-7029-450e-8803-6e0251f0d846', 'volume_name': 'volume-37eef083-7029-450e-8803-6e0251f0d846', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28136c70-3098-4860-b872-33e637a7b0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28136c70-3098-4860-b872-33e637a7b0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade4ed43-96bb-450a-b25b-ce92b1acc0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:26 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Volume 37eef083-7029-450e-8803-6e0251f0d846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37eef083-7029-450e-8803-6e0251f0d846', 'volume_size': 1} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2140386960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37eef083-7029-450e-8803-6e0251f0d846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29630b900eda4bac9688e8378c464846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:12:26Z,use_quota=True,user_id='f64b8105786f47bda7f51e6782c2ea1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Creating volume 37eef083-7029-450e-8803-6e0251f0d846 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:12:26 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:12:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:26 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 1073741824 Sep 28 15:12:26 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:27 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 1073741824" returned: 0 in 1.015s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:27 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 Sep 28 15:12:27 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:27 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846" returned: 0 in 0.627s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade4ed43-96bb-450a-b25b-ce92b1acc0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37eef083-7029-450e-8803-6e0251f0d846', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169f999e-f350-44ac-8420-ce4b5c7a56f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:12:27 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Volume volume-37eef083-7029-450e-8803-6e0251f0d846 (37eef083-7029-450e-8803-6e0251f0d846): created successfully Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169f999e-f350-44ac-8420-ce4b5c7a56f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:12:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Flow 'volume_create_manager' (6eef9e93-d969-491e-8646-87b0b514c592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:12:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-db3e7761-ad1f-45bf-bdfa-aed0ab09bdad tempest-TestMinimumBasicScenario-1144495236 None] Created volume successfully. Sep 28 15:12:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-c2553bd4-f0bf-4f8e-a2eb-2506d3780e0f req-6e3b6247-1ac4-4bbe-b0cb-72f85d77ea4c tempest-TestMinimumBasicScenario-1144495236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-c2553bd4-f0bf-4f8e-a2eb-2506d3780e0f req-6e3b6247-1ac4-4bbe-b0cb-72f85d77ea4c tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-c2553bd4-f0bf-4f8e-a2eb-2506d3780e0f req-6e3b6247-1ac4-4bbe-b0cb-72f85d77ea4c tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-c2553bd4-f0bf-4f8e-a2eb-2506d3780e0f req-6e3b6247-1ac4-4bbe-b0cb-72f85d77ea4c tempest-TestMinimumBasicScenario-1144495236 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-37eef083-7029-450e-8803-6e0251f0d846', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f5200bd-3c6e-4e8b-878f-7a511e9e91e4', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:12:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-c2553bd4-f0bf-4f8e-a2eb-2506d3780e0f req-6e3b6247-1ac4-4bbe-b0cb-72f85d77ea4c tempest-TestMinimumBasicScenario-1144495236 None] attachment_update completed successfully. Sep 28 15:12:40 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=28,cinder:SELECT=28,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:47 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:12:47 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:47 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.371s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:12:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:12:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=34,cinder:UPDATE=34,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:12:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Acquiring lock "cinder-3f38c223-7931-45d5-a240-641e5066485d-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "cinder-3f38c223-7931-45d5-a240-641e5066485d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Acquiring lock "cinder-quobyte-3f38c223-7931-45d5-a240-641e5066485d" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:12:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "cinder-quobyte-3f38c223-7931-45d5-a240-641e5066485d" acquired by "delete_volume" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:12:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b40306-1c12-4075-aded-6823805ce218]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:12:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:57 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d Sep 28 15:12:57 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:57 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d" returned: 0 in 0.606s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:58 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d Sep 28 15:12:58 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:58 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3f38c223-7931-45d5-a240-641e5066485d" returned: 0 in 0.398s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "cinder-quobyte-3f38c223-7931-45d5-a240-641e5066485d" released by "delete_volume" :: held 1.090s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Created reservations ['aa2ad20d-949d-4d96-ad0d-91d4e9c2546d', 'a78b9d60-5a44-4161-9256-f074aa925a13', '5856ca1c-ba5f-473f-9355-dc2b078f589b', 'e69424d9-1e2c-4d9b-83db-1f563bcf3dfc'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:12:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:12:58 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:12:58 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:12:59 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 28 15:12:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.371s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:12:59 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:12:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Deleted volume successfully. Sep 28 15:12:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8778be8-2711-4d93-9e90-b15fa6e21791 tempest-AttachVolumeShelveTestJSON-1943783342 None] Lock "cinder-3f38c223-7931-45d5-a240-641e5066485d-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:13:08 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:09 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:27 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Flow 'volume_create_manager' (b3363d6b-30b3-428e-ba3a-0d0fdb623dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7f3f0e-0304-4019-b5f7-00746f782161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7f3f0e-0304-4019-b5f7-00746f782161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-918323435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042bbc4d-cbfd-435c-984d-a1cfa56ad963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9970017ca74e9d93976d1374070b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:28Z,use_quota=True,user_id='c451d8c649804348a217bd4038f26f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e3cb9f-c2f4-4a3b-818c-3f63958cc631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e3cb9f-c2f4-4a3b-818c-3f63958cc631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c28a3fc-4a06-4448-97dc-553c9ec894b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c28a3fc-4a06-4448-97dc-553c9ec894b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042bbc4d-cbfd-435c-984d-a1cfa56ad963', 'volume_name': 'volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675f5417-4ec7-404e-a703-82ac86d04adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675f5417-4ec7-404e-a703-82ac86d04adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1cfe42-74d6-49e7-8d45-3c79fa6d867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:28 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Volume 042bbc4d-cbfd-435c-984d-a1cfa56ad963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963', 'volume_size': 1} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-918323435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042bbc4d-cbfd-435c-984d-a1cfa56ad963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9970017ca74e9d93976d1374070b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:28Z,use_quota=True,user_id='c451d8c649804348a217bd4038f26f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Creating volume 042bbc4d-cbfd-435c-984d-a1cfa56ad963 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:28 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:13:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:28 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 1073741824 Sep 28 15:13:28 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Flow 'volume_create_manager' (0025545f-1794-4536-a28d-d6e4367b8962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de642316-22c8-462b-8097-51418c45f0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de642316-22c8-462b-8097-51418c45f0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1399502493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be734e5d-f96c-42b1-8793-b382d0043982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9970017ca74e9d93976d1374070b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:29Z,use_quota=True,user_id='c451d8c649804348a217bd4038f26f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853a1d0e-2d8b-4bb4-ac59-d1e239ed6f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853a1d0e-2d8b-4bb4-ac59-d1e239ed6f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60abc3f-35f9-4483-a9dc-0de7efa41590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60abc3f-35f9-4483-a9dc-0de7efa41590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be734e5d-f96c-42b1-8793-b382d0043982', 'volume_name': 'volume-be734e5d-f96c-42b1-8793-b382d0043982', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e17802-ff52-4ee9-823a-bb79daece9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e17802-ff52-4ee9-823a-bb79daece9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d25221-66ad-4710-92ee-a750ab8f2010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Volume be734e5d-f96c-42b1-8793-b382d0043982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be734e5d-f96c-42b1-8793-b382d0043982', 'volume_size': 1} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 1073741824" returned: 0 in 1.116s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:29 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 Sep 28 15:13:29 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:29 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963" returned: 0 in 0.411s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1399502493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be734e5d-f96c-42b1-8793-b382d0043982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b9970017ca74e9d93976d1374070b97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:13:29Z,use_quota=True,user_id='c451d8c649804348a217bd4038f26f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Creating volume be734e5d-f96c-42b1-8793-b382d0043982 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:13:29 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1cfe42-74d6-49e7-8d45-3c79fa6d867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 1073741824 Sep 28 15:13:29 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb26b3e5-4f11-40d1-a113-74982dd14725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Volume volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 (042bbc4d-cbfd-435c-984d-a1cfa56ad963): created successfully Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb26b3e5-4f11-40d1-a113-74982dd14725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Flow 'volume_create_manager' (b3363d6b-30b3-428e-ba3a-0d0fdb623dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ccea5789-f2de-4217-98a1-7cd72d1097e1 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Created volume successfully. Sep 28 15:13:30 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 1073741824" returned: 0 in 0.812s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:30 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 Sep 28 15:13:30 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:31 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982" returned: 0 in 0.386s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:13:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:13:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d25221-66ad-4710-92ee-a750ab8f2010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be734e5d-f96c-42b1-8793-b382d0043982', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a08fd7-e2f1-4d51-9ec5-f34956fff692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:13:31 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Volume volume-be734e5d-f96c-42b1-8793-b382d0043982 (be734e5d-f96c-42b1-8793-b382d0043982): created successfully Sep 28 15:13:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a08fd7-e2f1-4d51-9ec5-f34956fff692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:13:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Flow 'volume_create_manager' (0025545f-1794-4536-a28d-d6e4367b8962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:13:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-55da9b6a-240d-4364-949e-3678b955c42b tempest-TestServerVolumeAttachmentScenario-2005494610 None] Created volume successfully. Sep 28 15:13:41 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:INSERT=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:41 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:13:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:13:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:13:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:13:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-b7d61301-88c5-4cae-b1b2-c282e34770db req-b4a7c54a-21c4-4806-8dec-a5702fe6fc9a tempest-TestMinimumBasicScenario-1144495236 None] Terminate volume connection completed successfully. Sep 28 15:13:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-b7d61301-88c5-4cae-b1b2-c282e34770db req-b4a7c54a-21c4-4806-8dec-a5702fe6fc9a tempest-TestMinimumBasicScenario-1144495236 None] Deleting attachment 1f5200bd-3c6e-4e8b-878f-7a511e9e91e4. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Acquiring lock "cinder-37eef083-7029-450e-8803-6e0251f0d846-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Lock "cinder-37eef083-7029-450e-8803-6e0251f0d846-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Acquiring lock "cinder-quobyte-37eef083-7029-450e-8803-6e0251f0d846" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Lock "cinder-quobyte-37eef083-7029-450e-8803-6e0251f0d846" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[23955ddd-e0ff-46e1-b02c-d356c3672456]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:59 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 Sep 28 15:13:59 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:13:59 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846" returned: 0 in 0.566s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:13:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:13:59 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846 Sep 28 15:13:59 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:00 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-37eef083-7029-450e-8803-6e0251f0d846" returned: 0 in 0.335s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Lock "cinder-quobyte-37eef083-7029-450e-8803-6e0251f0d846" released by "delete_volume" :: held 0.997s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Created reservations ['d7b8151a-5222-4152-abf7-4db81c8679c9', '8db725d7-2f40-48ed-b89e-cf46199f8855', 'a8b762ad-7460-4af7-a34a-64b1b7ce863e', 'bb6d3591-979d-4f96-b3c5-4d626fa7eb7a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:00 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:14:00 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:01 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.482s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:01 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:01 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Deleted volume successfully. Sep 28 15:14:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-abf5af4b-fdff-4403-bfc2-6bf0008968d8 tempest-TestMinimumBasicScenario-1144495236 None] Lock "cinder-37eef083-7029-450e-8803-6e0251f0d846-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Flow 'volume_create_manager' (3871fcfc-dce8-480f-b52b-7907dbc2c843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08946ed-4122-40cf-9fd8-698394d2ec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08946ed-4122-40cf-9fd8-698394d2ec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1250289473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd62971-faf3-45d1-82f6-9e6567e1ff78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8813fcfe054832b2602a876b07e1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:09Z,use_quota=True,user_id='d0151f439da342d080f61abae422238f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ec11b-0a0a-4944-b703-e2c7a14edc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69ec11b-0a0a-4944-b703-e2c7a14edc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185f4fc0-7028-46b5-a860-f14a0ac7937d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185f4fc0-7028-46b5-a860-f14a0ac7937d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd62971-faf3-45d1-82f6-9e6567e1ff78', 'volume_name': 'volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0cc098-3b6a-4b58-bff2-63486663c071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0cc098-3b6a-4b58-bff2-63486663c071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f27f1f4-05ea-4ff2-b0c7-e9aeba92b23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:09 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Volume 1bd62971-faf3-45d1-82f6-9e6567e1ff78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78', 'volume_size': 1} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1250289473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd62971-faf3-45d1-82f6-9e6567e1ff78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8813fcfe054832b2602a876b07e1f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:09Z,use_quota=True,user_id='d0151f439da342d080f61abae422238f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Creating volume 1bd62971-faf3-45d1-82f6-9e6567e1ff78 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:09 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:14:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:09 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 1073741824 Sep 28 15:14:09 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:10 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 1073741824" returned: 0 in 0.984s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:10 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 Sep 28 15:14:10 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:10 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78" returned: 0 in 0.456s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f27f1f4-05ea-4ff2-b0c7-e9aeba92b23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029ec2db-b26e-4051-b3e8-89250c36da30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:11 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Volume volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 (1bd62971-faf3-45d1-82f6-9e6567e1ff78): created successfully Sep 28 15:14:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029ec2db-b26e-4051-b3e8-89250c36da30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Flow 'volume_create_manager' (3871fcfc-dce8-480f-b52b-7907dbc2c843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a06e1b58-d2d8-4189-a677-dd0ee7659818 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Created volume successfully. Sep 28 15:14:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-c05fa9c7-ac1d-4ba8-a5bb-cd1309f57e9c req-a2a4d5dc-b2ea-43d1-8890-ab7e36bec1d1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-c05fa9c7-ac1d-4ba8-a5bb-cd1309f57e9c req-a2a4d5dc-b2ea-43d1-8890-ab7e36bec1d1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-c05fa9c7-ac1d-4ba8-a5bb-cd1309f57e9c req-a2a4d5dc-b2ea-43d1-8890-ab7e36bec1d1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-c05fa9c7-ac1d-4ba8-a5bb-cd1309f57e9c req-a2a4d5dc-b2ea-43d1-8890-ab7e36bec1d1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd512d3b1-c8e7-4264-a62d-440a8a891d2b', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:12 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-c05fa9c7-ac1d-4ba8-a5bb-cd1309f57e9c req-a2a4d5dc-b2ea-43d1-8890-ab7e36bec1d1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] attachment_update completed successfully. Sep 28 15:14:17 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-5e42a8e1-6782-44c6-9a3b-a202c3aa9528 req-90c5edfb-f079-4cd0-ab71-78cd3bb7a2bd tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Terminate volume connection completed successfully. Sep 28 15:14:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-5e42a8e1-6782-44c6-9a3b-a202c3aa9528 req-90c5edfb-f079-4cd0-ab71-78cd3bb7a2bd tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Deleting attachment d512d3b1-c8e7-4264-a62d-440a8a891d2b. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:14:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Acquiring lock "cinder-1bd62971-faf3-45d1-82f6-9e6567e1ff78-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "cinder-1bd62971-faf3-45d1-82f6-9e6567e1ff78-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Acquiring lock "cinder-quobyte-1bd62971-faf3-45d1-82f6-9e6567e1ff78" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "cinder-quobyte-1bd62971-faf3-45d1-82f6-9e6567e1ff78" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca2479-aed7-4e2f-a174-464bbb05aab9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:18 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 Sep 28 15:14:18 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:19 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78" returned: 0 in 0.480s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:19 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78 Sep 28 15:14:19 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:19 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1bd62971-faf3-45d1-82f6-9e6567e1ff78" returned: 0 in 0.548s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "cinder-quobyte-1bd62971-faf3-45d1-82f6-9e6567e1ff78" released by "delete_volume" :: held 1.116s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Created reservations ['326bb3db-ec53-4306-9f71-4ba47c526742', 'a9d4f685-c7bc-4743-bc93-cee0fdac101c', '2c4dc677-23a7-4915-a744-6f521cac7a34', '2c166b54-6aeb-4993-9c4d-97ed2f65693e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:19 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:14:19 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:20 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.527s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:20 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Deleted volume successfully. Sep 28 15:14:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c6b3d441-901f-491e-b98b-5dcd4316c5b1 tempest-TestServerVolumeAttachScenarioOldVersion-936812535 None] Lock "cinder-1bd62971-faf3-45d1-82f6-9e6567e1ff78-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d9f139d9-6c09-4b45-b582-b43a2c79fcb0 req-3471f876-ed08-4ccd-8a8b-535ce740e072 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d9f139d9-6c09-4b45-b582-b43a2c79fcb0 req-3471f876-ed08-4ccd-8a8b-535ce740e072 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d9f139d9-6c09-4b45-b582-b43a2c79fcb0 req-3471f876-ed08-4ccd-8a8b-535ce740e072 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-d9f139d9-6c09-4b45-b582-b43a2c79fcb0 req-3471f876-ed08-4ccd-8a8b-535ce740e072 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82904db7-3cd6-451c-a128-ab7be9d4a9ba', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-d9f139d9-6c09-4b45-b582-b43a2c79fcb0 req-3471f876-ed08-4ccd-8a8b-535ce740e072 tempest-TestServerVolumeAttachmentScenario-2005494610 None] attachment_update completed successfully. Sep 28 15:14:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-304fd359-6efb-4a47-a8f3-e5e7537e56a1 req-2767a6e1-e280-4cc1-bb22-d57b47fa492a tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-304fd359-6efb-4a47-a8f3-e5e7537e56a1 req-2767a6e1-e280-4cc1-bb22-d57b47fa492a tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-304fd359-6efb-4a47-a8f3-e5e7537e56a1 req-2767a6e1-e280-4cc1-bb22-d57b47fa492a tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-304fd359-6efb-4a47-a8f3-e5e7537e56a1 req-2767a6e1-e280-4cc1-bb22-d57b47fa492a tempest-TestServerVolumeAttachmentScenario-2005494610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-be734e5d-f96c-42b1-8793-b382d0043982', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '089be679-627e-4083-8a19-ee48276ee1f3', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-304fd359-6efb-4a47-a8f3-e5e7537e56a1 req-2767a6e1-e280-4cc1-bb22-d57b47fa492a tempest-TestServerVolumeAttachmentScenario-2005494610 None] attachment_update completed successfully. Sep 28 15:14:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-3c5ed8ef-0a79-47d3-9b1e-a932776de347 req-835a308c-024f-483a-8008-307134006830 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Terminate volume connection completed successfully. Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-3c5ed8ef-0a79-47d3-9b1e-a932776de347 req-835a308c-024f-483a-8008-307134006830 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Deleting attachment 089be679-627e-4083-8a19-ee48276ee1f3. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Flow 'volume_create_manager' (6f1e61b5-7676-43ff-aa2d-865cf15cbf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db6f17-5d16-4f0c-8981-1f2706ec0bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94db6f17-5d16-4f0c-8981-1f2706ec0bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2069589677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414bc76b-1c26-4355-b822-7d0e0b5c35e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d425975b3ce434cb1b3ebe2dfa9610c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:33Z,use_quota=True,user_id='430c4ddd7f5746c2b68c2b55b1af8ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e33fbb8-a121-4623-afb6-26b182c0a3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e33fbb8-a121-4623-afb6-26b182c0a3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ba5ba1-07e5-4416-93b3-9abf4aa479b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ba5ba1-07e5-4416-93b3-9abf4aa479b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414bc76b-1c26-4355-b822-7d0e0b5c35e4', 'volume_name': 'volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065a02fc-ad1d-4606-9098-0c192cc729a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065a02fc-ad1d-4606-9098-0c192cc729a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac671951-c577-4600-9a44-368317590301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:33 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Volume 414bc76b-1c26-4355-b822-7d0e0b5c35e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4', 'volume_size': 1} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2069589677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414bc76b-1c26-4355-b822-7d0e0b5c35e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d425975b3ce434cb1b3ebe2dfa9610c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:14:33Z,use_quota=True,user_id='430c4ddd7f5746c2b68c2b55b1af8ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Creating volume 414bc76b-1c26-4355-b822-7d0e0b5c35e4 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:14:33 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:14:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:33 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 1073741824 Sep 28 15:14:33 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:34 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 1073741824" returned: 0 in 1.045s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:34 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 Sep 28 15:14:34 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:35 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4" returned: 0 in 0.446s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac671951-c577-4600-9a44-368317590301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8707d6ae-2d83-4850-87c7-73102f2b329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:14:35 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Volume volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 (414bc76b-1c26-4355-b822-7d0e0b5c35e4): created successfully Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8707d6ae-2d83-4850-87c7-73102f2b329f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Flow 'volume_create_manager' (6f1e61b5-7676-43ff-aa2d-865cf15cbf54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:14:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-75bc7f58-8d7e-41d4-ba76-75e0dd2d21e7 tempest-AttachVolumeTestJSON-1980644169 None] Created volume successfully. Sep 28 15:14:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-dcc131b2-ac1a-4499-b6dc-383fc92d364b req-f1d4260a-55d6-4174-bc29-ea37bcd784cc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Terminate volume connection completed successfully. Sep 28 15:14:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-dcc131b2-ac1a-4499-b6dc-383fc92d364b req-f1d4260a-55d6-4174-bc29-ea37bcd784cc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Deleting attachment 82904db7-3cd6-451c-a128-ab7be9d4a9ba. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:14:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d53a9301-dad2-4df0-9e1b-d802d8e7eb14 req-d3b4048d-5f04-47ab-b5b9-5b55e465607c tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d53a9301-dad2-4df0-9e1b-d802d8e7eb14 req-d3b4048d-5f04-47ab-b5b9-5b55e465607c tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d53a9301-dad2-4df0-9e1b-d802d8e7eb14 req-d3b4048d-5f04-47ab-b5b9-5b55e465607c tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.070s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-d53a9301-dad2-4df0-9e1b-d802d8e7eb14 req-d3b4048d-5f04-47ab-b5b9-5b55e465607c tempest-AttachVolumeTestJSON-1980644169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0a2ea96-0954-4ad1-a04b-8ccbc0ad821a', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:14:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-d53a9301-dad2-4df0-9e1b-d802d8e7eb14 req-d3b4048d-5f04-47ab-b5b9-5b55e465607c tempest-AttachVolumeTestJSON-1980644169 None] attachment_update completed successfully. Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:47 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:14:47 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:47 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.472s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:14:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:14:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=48,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=41,cinder:INSERT=5,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:14:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "cinder-be734e5d-f96c-42b1-8793-b382d0043982-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-be734e5d-f96c-42b1-8793-b382d0043982-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "cinder-quobyte-be734e5d-f96c-42b1-8793-b382d0043982" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-quobyte-be734e5d-f96c-42b1-8793-b382d0043982" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:51 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fad4399-b292-4537-8bd4-21ef966ac877]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:51 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 Sep 28 15:14:51 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:52 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982" returned: 0 in 0.651s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:52 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982 Sep 28 15:14:52 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:52 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-be734e5d-f96c-42b1-8793-b382d0043982" returned: 0 in 0.455s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-quobyte-be734e5d-f96c-42b1-8793-b382d0043982" released by "delete_volume" :: held 1.245s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Created reservations ['cf9dc13f-d858-4dcb-b2f4-9ded6575c4b3', 'a15f57d0-b043-433c-942c-cad61559bb03', 'eb8045e2-730d-424d-a514-e8c7a18dffd3', '29db0440-bb69-4be9-b4a2-8a4fd490014f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:53 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:14:53 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:53 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.421s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:53 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Deleted volume successfully. Sep 28 15:14:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3a7958d9-03a4-4f37-80ee-fd14fd450504 tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-be734e5d-f96c-42b1-8793-b382d0043982-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "cinder-042bbc4d-cbfd-435c-984d-a1cfa56ad963-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-042bbc4d-cbfd-435c-984d-a1cfa56ad963-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "cinder-quobyte-042bbc4d-cbfd-435c-984d-a1cfa56ad963" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:14:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-quobyte-042bbc4d-cbfd-435c-984d-a1cfa56ad963" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:14:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f68d0d7-aedf-4914-aed9-028dca64127d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:14:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:54 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 Sep 28 15:14:54 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:55 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963" returned: 0 in 0.744s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:55 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963 Sep 28 15:14:55 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:55 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-042bbc4d-cbfd-435c-984d-a1cfa56ad963" returned: 0 in 0.700s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-quobyte-042bbc4d-cbfd-435c-984d-a1cfa56ad963" released by "delete_volume" :: held 1.532s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:14:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Created reservations ['d6e0a93b-667d-48c6-904c-22fe136fe966', 'a20e3656-9b9c-49a0-85b9-151cc6f1f233', '59092ab3-af22-44b1-a65e-1d67fd33ccdf', '875260fc-0012-4cb0-8d49-0f81e19b5509'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:14:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:14:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:14:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:14:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:14:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:14:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:14:56 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:14:56 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:14:57 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 28 15:14:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.671s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:14:57 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:14:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Deleted volume successfully. Sep 28 15:14:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8df29d2a-af49-4e8b-9596-8f6ebe4f32fc tempest-TestServerVolumeAttachmentScenario-2005494610 None] Lock "cinder-042bbc4d-cbfd-435c-984d-a1cfa56ad963-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Flow 'volume_create_manager' (d19d2bdf-2909-4470-bfb9-0b58b795c208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57622999-177a-43dd-92cd-10d730f22ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57622999-177a-43dd-92cd-10d730f22ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ab0021-30c5-412d-9d4b-23f3883f877b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b5bb643eab42b0a72ecaab55622dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:02Z,use_quota=True,user_id='534591a8327e478fa1886f08986ed617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8be5094-b8f2-410b-8767-d31d154b1aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8be5094-b8f2-410b-8767-d31d154b1aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab8c658-e383-481e-adc4-1f1cbeff3198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab8c658-e383-481e-adc4-1f1cbeff3198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3ab0021-30c5-412d-9d4b-23f3883f877b', 'volume_name': 'volume-b3ab0021-30c5-412d-9d4b-23f3883f877b', 'volume_size': 1, 'image_id': '74030229-ddb1-4fde-be93-26a550d629f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74030229-ddb1-4fde-be93-26a550d629f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '331a0b71aaa9da0a79b6efa809cb25ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58b5bb643eab42b0a72ecaab55622dd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b2034d14364c3f8e6545963406f968a3e61a900dc00efe2d88d192cde3271dc3772a4b4d4ad42cff9d4229074e761a66c8fe88c81a6e5894179175ebda1cfb7', 'id': '74030229-ddb1-4fde-be93-26a550d629f1', 'created_at': datetime.datetime(2026, 9, 28, 13, 14, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74030229-ddb1-4fde-be93-26a550d629f1/file', 'properties': {}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4968e398-12da-4ca8-86bc-d2f67edf8b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4968e398-12da-4ca8-86bc-d2f67edf8b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2de284-f3f3-4569-88a0-7cda53388d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Volume b3ab0021-30c5-412d-9d4b-23f3883f877b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3ab0021-30c5-412d-9d4b-23f3883f877b', 'volume_size': 1, 'image_id': '74030229-ddb1-4fde-be93-26a550d629f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74030229-ddb1-4fde-be93-26a550d629f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '331a0b71aaa9da0a79b6efa809cb25ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58b5bb643eab42b0a72ecaab55622dd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b2034d14364c3f8e6545963406f968a3e61a900dc00efe2d88d192cde3271dc3772a4b4d4ad42cff9d4229074e761a66c8fe88c81a6e5894179175ebda1cfb7', 'id': '74030229-ddb1-4fde-be93-26a550d629f1', 'created_at': datetime.datetime(2026, 9, 28, 13, 14, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74030229-ddb1-4fde-be93-26a550d629f1/file', 'properties': {}}, 'image_service': } Sep 28 15:15:02 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Trying to clone b3ab0021-30c5-412d-9d4b-23f3883f877b from image 74030229-ddb1-4fde-be93-26a550d629f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/74030229-ddb1-4fde-be93-26a550d629f1', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:15:03 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:15:03 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:15:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[72890e1f-9a83-414c-b3f3-5e949eec9bb9]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:03 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD Sep 28 15:15:03 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:03 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:04 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD Sep 28 15:15:04 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:04 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD" returned: 1 in 0.599s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:04 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Temporary image 74030229-ddb1-4fde-be93-26a550d629f1 is fetched for user 534591a8327e478fa1886f08986ed617. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:15:04 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdce78b-a503-4524-8991-2d739f48a6cf]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:04 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD Sep 28 15:15:04 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:05 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:05 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD Sep 28 15:15:05 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:06 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD" returned: 1 in 0.543s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ab0021-30c5-412d-9d4b-23f3883f877b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b5bb643eab42b0a72ecaab55622dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:02Z,use_quota=True,user_id='534591a8327e478fa1886f08986ed617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Creating volume b3ab0021-30c5-412d-9d4b-23f3883f877b {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:06 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:15:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:06 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b 1073741824 Sep 28 15:15:06 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:07 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b 1073741824" returned: 0 in 1.096s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:07 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b Sep 28 15:15:07 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:07 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b" returned: 0 in 0.523s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Attempting download of 74030229-ddb1-4fde-be93-26a550d629f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/74030229-ddb1-4fde-be93-26a550d629f1', 'metadata': {}}])) to volume b3ab0021-30c5-412d-9d4b-23f3883f877b. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3c7aeb-6c3c-432c-adad-444e49a516a4]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74030229-ddb1-4fde-be93-26a550d629f1_lone7i8z {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:08 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74030229-ddb1-4fde-be93-26a550d629f1_lone7i8z Sep 28 15:15:08 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:08 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_74030229-ddb1-4fde-be93-26a550d629f1_lone7i8z" returned: 0 in 0.705s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74030229-ddb1-4fde-be93-26a550d629f1_lone7i8z {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:08 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74030229-ddb1-4fde-be93-26a550d629f1_lone7i8z Sep 28 15:15:08 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:09 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74030229-ddb1-4fde-be93-26a550d629f1_lone7i8z" returned: 1 in 0.527s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_74030229-ddb1-4fde-be93-26a550d629f1_lone7i8z' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:09 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[060bf7b7-a25e-40c2-b16d-f3fc315df2db]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:09 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD Sep 28 15:15:09 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:09 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:10 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD Sep 28 15:15:10 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:10 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:15:10 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] 74030229-ddb1-4fde-be93-26a550d629f1 was raw, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:15:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:10 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b Sep 28 15:15:10 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:11 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b" returned: 0 in 1.024s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:11 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_74030229-ddb1-4fde-be93-26a550d629f1_6je8b_mkdevstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:15:11 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:15:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:11 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b 1G Sep 28 15:15:11 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Flow 'volume_create_manager' (d0443834-5f6d-4f63-8d1b-5eff290a14e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a01dd93-1df1-4459-9cb0-d2286ab79f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a01dd93-1df1-4459-9cb0-d2286ab79f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-305469939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733eb5cf-5bd5-4243-9eae-85db23215698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd1bc4a6e93462e8b2c4c2ec079d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:12Z,use_quota=True,user_id='674f76ce736b438f8b92c6c53d50bfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4196b4e3-5a99-45e6-aca8-6c3ca1cc2e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4196b4e3-5a99-45e6-aca8-6c3ca1cc2e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cd66fa-f14f-4976-9da7-a350313a7a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92cd66fa-f14f-4976-9da7-a350313a7a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733eb5cf-5bd5-4243-9eae-85db23215698', 'volume_name': 'volume-733eb5cf-5bd5-4243-9eae-85db23215698', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6670a270-a6cc-4c85-b909-4c50e99d739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6670a270-a6cc-4c85-b909-4c50e99d739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3097d0f9-6408-4d0c-8ca3-d1827e950a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:12 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Volume 733eb5cf-5bd5-4243-9eae-85db23215698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733eb5cf-5bd5-4243-9eae-85db23215698', 'volume_size': 1} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-305469939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733eb5cf-5bd5-4243-9eae-85db23215698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd1bc4a6e93462e8b2c4c2ec079d428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:15:12Z,use_quota=True,user_id='674f76ce736b438f8b92c6c53d50bfc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Creating volume 733eb5cf-5bd5-4243-9eae-85db23215698 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:12 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:15:12 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b 1G" returned: 0 in 0.975s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Downloaded image 74030229-ddb1-4fde-be93-26a550d629f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/74030229-ddb1-4fde-be93-26a550d629f1', 'metadata': {}}])) to volume b3ab0021-30c5-412d-9d4b-23f3883f877b successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Temporary image 74030229-ddb1-4fde-be93-26a550d629f1 for user 534591a8327e478fa1886f08986ed617 is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Marking volume b3ab0021-30c5-412d-9d4b-23f3883f877b as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Copying metadata from image 74030229-ddb1-4fde-be93-26a550d629f1 to b3ab0021-30c5-412d-9d4b-23f3883f877b. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Creating volume glance metadata for volume b3ab0021-30c5-412d-9d4b-23f3883f877b backed by image 74030229-ddb1-4fde-be93-26a550d629f1 with: {'image_id': '74030229-ddb1-4fde-be93-26a550d629f1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '331a0b71aaa9da0a79b6efa809cb25ee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:15:12 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 1073741824 Sep 28 15:15:12 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2de284-f3f3-4569-88a0-7cda53388d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ab0021-30c5-412d-9d4b-23f3883f877b', 'volume_size': 1, 'image_id': '74030229-ddb1-4fde-be93-26a550d629f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/74030229-ddb1-4fde-be93-26a550d629f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '331a0b71aaa9da0a79b6efa809cb25ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58b5bb643eab42b0a72ecaab55622dd4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b2034d14364c3f8e6545963406f968a3e61a900dc00efe2d88d192cde3271dc3772a4b4d4ad42cff9d4229074e761a66c8fe88c81a6e5894179175ebda1cfb7', 'id': '74030229-ddb1-4fde-be93-26a550d629f1', 'created_at': datetime.datetime(2026, 9, 28, 13, 14, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/74030229-ddb1-4fde-be93-26a550d629f1/file', 'properties': {}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5800e80-a79a-4275-a719-b8ddc5a0fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Volume volume-b3ab0021-30c5-412d-9d4b-23f3883f877b (b3ab0021-30c5-412d-9d4b-23f3883f877b): created successfully Sep 28 15:15:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5800e80-a79a-4275-a719-b8ddc5a0fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Flow 'volume_create_manager' (d19d2bdf-2909-4470-bfb9-0b58b795c208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ae9ba254-83c8-4d83-adc4-a38542656298 tempest-VolumeImageDependencyTests-311732737 None] Created volume successfully. Sep 28 15:15:13 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 1073741824" returned: 0 in 1.026s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:13 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 Sep 28 15:15:13 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Acquiring lock "cinder-b3ab0021-30c5-412d-9d4b-23f3883f877b-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Lock "cinder-b3ab0021-30c5-412d-9d4b-23f3883f877b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:14 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698" returned: 0 in 0.372s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Acquiring lock "cinder-quobyte-b3ab0021-30c5-412d-9d4b-23f3883f877b" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3097d0f9-6408-4d0c-8ca3-d1827e950a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733eb5cf-5bd5-4243-9eae-85db23215698', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294ea091-f69a-40d0-87af-673bed85367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Lock "cinder-quobyte-b3ab0021-30c5-412d-9d4b-23f3883f877b" acquired by "delete_volume" :: waited 0.036s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:15:14 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Volume volume-733eb5cf-5bd5-4243-9eae-85db23215698 (733eb5cf-5bd5-4243-9eae-85db23215698): created successfully Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294ea091-f69a-40d0-87af-673bed85367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Flow 'volume_create_manager' (d0443834-5f6d-4f63-8d1b-5eff290a14e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2886c3d-e7a5-4632-9e8a-bea9d13c92e7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-41007ae3-9963-4e86-93ef-20541f3fad04 tempest-TestImageHashVerification-53662801 None] Created volume successfully. Sep 28 15:15:14 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b Sep 28 15:15:14 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:14 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b" returned: 0 in 0.474s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:14 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b Sep 28 15:15:14 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:15 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b3ab0021-30c5-412d-9d4b-23f3883f877b" returned: 0 in 0.334s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Lock "cinder-quobyte-b3ab0021-30c5-412d-9d4b-23f3883f877b" released by "delete_volume" :: held 0.890s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Created reservations ['c4f4c5a2-9818-4a4f-acae-426985c56bb2', '35b4b995-6f50-4775-a13d-9a02695a9f58', '2ba29204-4858-4e1d-8932-b44c9aed6c5a', 'edd64ff8-9c66-4eda-836d-441274df4c4a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:15 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:15:15 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:15 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.346s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:15 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Deleted volume successfully. Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-78ea9409-9522-41e0-ae46-838580ef2d95 tempest-VolumeImageDependencyTests-311732737 None] Lock "cinder-b3ab0021-30c5-412d-9d4b-23f3883f877b-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cae1ad-1ffa-407b-a653-65602be6491d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:16 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 Sep 28 15:15:16 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:16 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698" returned: 0 in 0.514s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:16 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc78999-1be2-402f-b15a-9de90fbfd11d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:16 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 Sep 28 15:15:16 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:16 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698" returned: 0 in 0.510s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 /opt/stack/data/cinder/conversion/733eb5cf-5bd5-4243-9eae-85db23215698.temp_image.4956ce1c-d8dc-4af8-bb39-ffb8f390502fvsyanvow.img {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:17 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 /opt/stack/data/cinder/conversion/733eb5cf-5bd5-4243-9eae-85db23215698.temp_image.4956ce1c-d8dc-4af8-bb39-ffb8f390502fvsyanvow.img Sep 28 15:15:17 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:25 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=28,cinder:INSERT=12,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:25 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:28 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 /opt/stack/data/cinder/conversion/733eb5cf-5bd5-4243-9eae-85db23215698.temp_image.4956ce1c-d8dc-4af8-bb39-ffb8f390502fvsyanvow.img" returned: 0 in 11.137s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a55021c-c80f-46e5-9ab4-ff3bb269ae2a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:15:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-77768f70-8c82-4b1d-af79-9a759f73ba2c req-a09c4e5b-f6e6-4ba2-97d2-846ad3f94861 tempest-AttachVolumeTestJSON-1980644169 None] Terminate volume connection completed successfully. Sep 28 15:15:28 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-77768f70-8c82-4b1d-af79-9a759f73ba2c req-a09c4e5b-f6e6-4ba2-97d2-846ad3f94861 tempest-AttachVolumeTestJSON-1980644169 None] Deleting attachment d0a2ea96-0954-4ad1-a04b-8ccbc0ad821a. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:15:28 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 Sep 28 15:15:28 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:28 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698" returned: 0 in 0.781s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:28 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698, size 1024.00 MB, duration 11.14 sec, destination /opt/stack/data/cinder/conversion/733eb5cf-5bd5-4243-9eae-85db23215698.temp_image.4956ce1c-d8dc-4af8-bb39-ffb8f390502fvsyanvow.img {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:15:28 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Converted 1024.00 MB image at 91.94 MB/s Sep 28 15:15:28 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] 4956ce1c-d8dc-4af8-bb39-ffb8f390502f was raw, no need to convert to raw {{(pid=86301) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 15:15:38 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:38 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:15:47 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:15:47 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:15:47 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.573s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:15:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:16:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 50.908s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Uploaded volume to glance image-id: 4956ce1c-d8dc-4af8-bb39-ffb8f390502f. {{(pid=86301) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 15:16:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e111381b-1942-4ad8-8415-a189a35ac594 tempest-TestImageHashVerification-53662801 None] Copy volume to image completed successfully. Sep 28 15:16:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Acquiring lock "cinder-733eb5cf-5bd5-4243-9eae-85db23215698-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Lock "cinder-733eb5cf-5bd5-4243-9eae-85db23215698-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Acquiring lock "cinder-quobyte-733eb5cf-5bd5-4243-9eae-85db23215698" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Lock "cinder-quobyte-733eb5cf-5bd5-4243-9eae-85db23215698" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bb7f68-f306-48a0-8866-10350409434c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:08 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 Sep 28 15:16:08 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:08 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698" returned: 0 in 0.523s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:08 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698 Sep 28 15:16:08 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:09 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-733eb5cf-5bd5-4243-9eae-85db23215698" returned: 0 in 0.449s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Lock "cinder-quobyte-733eb5cf-5bd5-4243-9eae-85db23215698" released by "delete_volume" :: held 1.065s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Created reservations ['75c6c07d-c87c-4aa6-8bb0-5e8426d83aab', '551c4e82-6880-4516-b0b6-24b3c6a53e83', 'aa8da2f2-56f7-4fd0-a6e2-0d786b1a66bb', '181225d9-6af1-4bac-aa11-63ee8be2c9b2'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:09 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:16:09 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:09 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.415s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Deleted volume successfully. Sep 28 15:16:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7abbeed-f432-412f-9089-d6ff4d1529c1 tempest-TestImageHashVerification-53662801 None] Lock "cinder-733eb5cf-5bd5-4243-9eae-85db23215698-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:19 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:19 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:16:20 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Flow 'volume_create_manager' (c4aec24d-7aec-46a0-b516-45e0a1d7866d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99603dd-1771-4c68-aba1-7f2af39d9782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99603dd-1771-4c68-aba1-7f2af39d9782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-473113340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf79ad9-6570-4643-a348-b64286d66744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28aa2a7cb10741dc873a87df75161ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:21Z,use_quota=True,user_id='b3e01b8979eb4edaab28e8e9d57cc924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358fbb02-6f0b-4be1-ac19-dc916339c182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358fbb02-6f0b-4be1-ac19-dc916339c182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d201d1-b168-43f6-871b-ab70845e6f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65d201d1-b168-43f6-871b-ab70845e6f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf79ad9-6570-4643-a348-b64286d66744', 'volume_name': 'volume-7bf79ad9-6570-4643-a348-b64286d66744', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c52e5c-3b5e-435a-9227-24ac84d69e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c52e5c-3b5e-435a-9227-24ac84d69e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eaf5923-c569-4159-98a5-e9112403f554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:21 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Volume 7bf79ad9-6570-4643-a348-b64286d66744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf79ad9-6570-4643-a348-b64286d66744', 'volume_size': 1} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-473113340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf79ad9-6570-4643-a348-b64286d66744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28aa2a7cb10741dc873a87df75161ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:21Z,use_quota=True,user_id='b3e01b8979eb4edaab28e8e9d57cc924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Creating volume 7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:21 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 1073741824 Sep 28 15:16:21 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:21 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 1073741824" returned: 0 in 0.742s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:21 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 Sep 28 15:16:21 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:22 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744" returned: 0 in 0.402s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eaf5923-c569-4159-98a5-e9112403f554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf79ad9-6570-4643-a348-b64286d66744', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa57ac-cc7e-4fe6-9954-2a60fd7adf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:22 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Volume volume-7bf79ad9-6570-4643-a348-b64286d66744 (7bf79ad9-6570-4643-a348-b64286d66744): created successfully Sep 28 15:16:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa57ac-cc7e-4fe6-9954-2a60fd7adf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Flow 'volume_create_manager' (c4aec24d-7aec-46a0-b516-45e0a1d7866d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5a663ec5-a1da-4905-928c-4fdf4e8d45c8 tempest-SnapshotDependencyTests-1867179221 None] Created volume successfully. Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Flow 'volume_create_manager' (4b4dfa31-17a0-4e7d-b9d2-54f7a9c06ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8001225-5470-45df-9637-d679f588883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8001225-5470-45df-9637-d679f588883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-214445844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00968453-4763-40bf-8718-e37f5cb32bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a4c2e28d742c99d2a1f3ba8d4bfa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:23Z,use_quota=True,user_id='d057d06e7f27451e95644de46685873c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d500b6d-fc8f-4057-b917-397dd58910e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d500b6d-fc8f-4057-b917-397dd58910e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc50748-e888-4a9a-81ea-5ea7346c8037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Creating offline snapshot 02bc0a96-6718-453d-aa67-79ea69aeec15 of volume 7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ade8d-43d5-48e5-b742-acdc60982017]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:23 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 Sep 28 15:16:23 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc50748-e888-4a9a-81ea-5ea7346c8037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '00968453-4763-40bf-8718-e37f5cb32bcb', 'volume_name': 'volume-00968453-4763-40bf-8718-e37f5cb32bcb', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256b383b-6511-4806-9062-6a0ccf27042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256b383b-6511-4806-9062-6a0ccf27042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308c951d-0b03-4aef-91cf-03d1e3475030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Volume 00968453-4763-40bf-8718-e37f5cb32bcb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-00968453-4763-40bf-8718-e37f5cb32bcb', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Trying to clone 00968453-4763-40bf-8718-e37f5cb32bcb from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:16:24 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744" returned: 0 in 0.873s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:16:24 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:16:24 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 1G Sep 28 15:16:24 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[225da7ee-117b-4d70-8bb9-53c318a24855]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:24 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD Sep 28 15:16:24 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c is fetched for user d057d06e7f27451e95644de46685873c. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:16:25 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 1G" returned: 0 in 0.835s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf79ad9-6570-4643-a348-b64286d66744 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf79ad9-6570-4643-a348-b64286d66744 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 Sep 28 15:16:25 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:25 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86e9f7a-aa58-42c4-b3fa-a32401490ee3]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:25 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD Sep 28 15:16:25 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf79ad9-6570-4643-a348-b64286d66744 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15" returned: 0 in 0.711s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:26 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 is being set with open permissions: ugo+rw Sep 28 15:16:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 Sep 28 15:16:26 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:26 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:26 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15" returned: 0 in 0.657s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:26 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.info Sep 28 15:16:26 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.info" returned: 0 in 0.374s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.info is being set with open permissions: ugo+rw Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.info Sep 28 15:16:27 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.info" returned: 0 in 0.378s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-214445844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00968453-4763-40bf-8718-e37f5cb32bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522a4c2e28d742c99d2a1f3ba8d4bfa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:23Z,use_quota=True,user_id='d057d06e7f27451e95644de46685873c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Creating volume 00968453-4763-40bf-8718-e37f5cb32bcb {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:27 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:16:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:27 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb 1073741824 Sep 28 15:16:27 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0259030c-c08d-47d8-9650-9744427b7d70 tempest-SnapshotDependencyTests-1867179221 None] Create snapshot completed successfully Sep 28 15:16:28 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb 1073741824" returned: 0 in 1.019s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:28 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb Sep 28 15:16:28 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Flow 'volume_create_manager' (76072e0b-2b62-4183-9c52-557ba9d56f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:29 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6177f8f9-6512-40c6-9a47-9319d685882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb" returned: 0 in 0.433s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6177f8f9-6512-40c6-9a47-9319d685882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b20167-677e-440b-8ad7-5ef4c2111ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28aa2a7cb10741dc873a87df75161ed2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02bc0a96-6718-453d-aa67-79ea69aeec15,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:29Z,use_quota=True,user_id='b3e01b8979eb4edaab28e8e9d57cc924',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d7989b-12c9-42b1-a147-4632bdd626f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d7989b-12c9-42b1-a147-4632bdd626f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870ce459-98b5-416f-aa64-a6141107a89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870ce459-98b5-416f-aa64-a6141107a89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0b20167-677e-440b-8ad7-5ef4c2111ab6', 'volume_name': 'volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6', 'volume_size': 1, 'snapshot_id': '02bc0a96-6718-453d-aa67-79ea69aeec15'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac29f8d8-45a2-43db-ab4c-358e9fcd0c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac29f8d8-45a2-43db-ab4c-358e9fcd0c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdb039b-6b1f-48bc-aecc-bba3f52f25a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Volume f0b20167-677e-440b-8ad7-5ef4c2111ab6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6', 'volume_size': 1, 'snapshot_id': '02bc0a96-6718-453d-aa67-79ea69aeec15'} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-quobyte-02bc0a96-6718-453d-aa67-79ea69aeec15-f0b20167-677e-440b-8ad7-5ef4c2111ab6" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Attempting download of 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume 00968453-4763-40bf-8718-e37f5cb32bcb. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-02bc0a96-6718-453d-aa67-79ea69aeec15-f0b20167-677e-440b-8ad7-5ef4c2111ab6" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Creating volume f0b20167-677e-440b-8ad7-5ef4c2111ab6 from snapshot 02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-quobyte-f0b20167-677e-440b-8ad7-5ef4c2111ab6" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-f0b20167-677e-440b-8ad7-5ef4c2111ab6" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] snapshot: 02bc0a96-6718-453d-aa67-79ea69aeec15, volume: f0b20167-677e-440b-8ad7-5ef4c2111ab6, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e11c50-7fea-4330-80d3-f8af4afc3a47]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_q9n5rye1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3323918d-a168-4ff4-af2f-f07a4c581aca]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:29 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_q9n5rye1 Sep 28 15:16:29 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:29 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 Sep 28 15:16:29 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_q9n5rye1" returned: 0 in 0.514s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_q9n5rye1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_q9n5rye1 Sep 28 15:16:30 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15" returned: 0 in 0.806s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf79ad9-6570-4643-a348-b64286d66744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64178b7-5c7c-49d2-859a-65d9fa4e30dd]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_q9n5rye1" returned: 1 in 0.498s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_q9n5rye1' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536ed6a-a2e5-46b0-8177-b2bb7efd1cf9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:30 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 Sep 28 15:16:30 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:30 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD Sep 28 15:16:30 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744" returned: 0 in 0.679s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c was qcow2, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:16:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:31 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 Sep 28 15:16:31 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:31 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb Sep 28 15:16:31 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:37 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb" returned: 0 in 6.599s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:37 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_695ni3jxdevstack@QuobyteHD, size 112.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:16:37 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Converted 112.00 MB image at 16.96 MB/s Sep 28 15:16:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:37 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb 1G Sep 28 15:16:37 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (7d128f69-483e-4702-91ed-5d87a3e4608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fac7fcf-554e-4533-a7a8-fafd1e17c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fac7fcf-554e-4533-a7a8-fafd1e17c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551098452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51407910-a84d-4895-b765-db709843d57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:38Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af60e255-2f95-466c-907d-118e28deca52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af60e255-2f95-466c-907d-118e28deca52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f142f1-6170-44c4-8ca0-58ea4f9b8daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f142f1-6170-44c4-8ca0-58ea4f9b8daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51407910-a84d-4895-b765-db709843d57f', 'volume_name': 'volume-51407910-a84d-4895-b765-db709843d57f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97da6f0-e131-439a-908e-237f8cac9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97da6f0-e131-439a-908e-237f8cac9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f7adb0-f39f-4cdb-b479-f4fff73d68ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:38 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume 51407910-a84d-4895-b765-db709843d57f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51407910-a84d-4895-b765-db709843d57f', 'volume_size': 1} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:38 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb 1G" returned: 0 in 0.888s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Downloaded image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume 00968453-4763-40bf-8718-e37f5cb32bcb successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c for user d057d06e7f27451e95644de46685873c is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Marking volume 00968453-4763-40bf-8718-e37f5cb32bcb as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Copying metadata from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c to 00968453-4763-40bf-8718-e37f5cb32bcb. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:16:38 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Creating volume glance metadata for volume 00968453-4763-40bf-8718-e37f5cb32bcb backed by image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:16:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308c951d-0b03-4aef-91cf-03d1e3475030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00968453-4763-40bf-8718-e37f5cb32bcb', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e81400-cf58-4ed7-938b-f31dd8735e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:39 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Volume volume-00968453-4763-40bf-8718-e37f5cb32bcb (00968453-4763-40bf-8718-e37f5cb32bcb): created successfully Sep 28 15:16:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e81400-cf58-4ed7-938b-f31dd8735e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Flow 'volume_create_manager' (4b4dfa31-17a0-4e7d-b9d2-54f7a9c06ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c41957fe-0f9f-4b3b-beeb-1f8701dfe0b7 tempest-TestShelveInstance-996076117 None] Created volume successfully. Sep 28 15:16:41 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6" returned: 0 in 10.732s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:41 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744, size 1024.00 MB, duration 10.74 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:16:41 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Converted 1024.00 MB image at 95.39 MB/s Sep 28 15:16:41 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 is being set with open permissions: ugo+rw Sep 28 15:16:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:41 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 Sep 28 15:16:41 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:42 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6" returned: 0 in 0.404s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-f0b20167-677e-440b-8ad7-5ef4c2111ab6" released by "_copy_volume_from_snapshot" :: held 12.813s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-02bc0a96-6718-453d-aa67-79ea69aeec15-f0b20167-677e-440b-8ad7-5ef4c2111ab6" released by "_create_volume_from_snapshot" :: held 12.965s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.998s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.936s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551098452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51407910-a84d-4895-b765-db709843d57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:38Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Creating volume 51407910-a84d-4895-b765-db709843d57f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:42 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:42 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f 1073741824 Sep 28 15:16:42 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdb039b-6b1f-48bc-aecc-bba3f52f25a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6', 'volume_size': 1, 'snapshot_id': '02bc0a96-6718-453d-aa67-79ea69aeec15'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251699fd-9d72-4a4c-a5bc-f3df3a126614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:42 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Volume volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 (f0b20167-677e-440b-8ad7-5ef4c2111ab6): created successfully Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251699fd-9d72-4a4c-a5bc-f3df3a126614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Flow 'volume_create_manager' (76072e0b-2b62-4183-9c52-557ba9d56f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:42 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bace7cf3-d2cc-45d8-83f4-548463c57229 tempest-SnapshotDependencyTests-1867179221 None] Created volume successfully. Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-02bc0a96-6718-453d-aa67-79ea69aeec15-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-02bc0a96-6718-453d-aa67-79ea69aeec15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-quobyte-7bf79ad9-6570-4643-a348-b64286d66744" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-7bf79ad9-6570-4643-a348-b64286d66744" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-quobyte-02bc0a96-6718-453d-aa67-79ea69aeec15" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-02bc0a96-6718-453d-aa67-79ea69aeec15" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Deleting offline snapshot 02bc0a96-6718-453d-aa67-79ea69aeec15 of volume 7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] snapshot_file for this snap is: volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e490be-7688-4799-aa38-333424ae246d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:43 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f 1073741824" returned: 0 in 0.903s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:43 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f Sep 28 15:16:43 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:43 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 Sep 28 15:16:43 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:43 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15" returned: 0 in 0.614s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf79ad9-6570-4643-a348-b64286d66744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:16:43 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f" returned: 0 in 0.526s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04bf229-0263-4732-a801-6c08ba2a9070]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f7adb0-f39f-4cdb-b479-f4fff73d68ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51407910-a84d-4895-b765-db709843d57f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48aa5f54-0802-4ed0-9a1a-436c8a317f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:44 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume volume-51407910-a84d-4895-b765-db709843d57f (51407910-a84d-4895-b765-db709843d57f): created successfully Sep 28 15:16:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48aa5f54-0802-4ed0-9a1a-436c8a317f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (7d128f69-483e-4702-91ed-5d87a3e4608d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6aa26d50-2f83-49a2-b32e-e91d3044d765 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created volume successfully. Sep 28 15:16:44 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 Sep 28 15:16:44 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:44 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744" returned: 0 in 0.880s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:44 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 Sep 28 15:16:44 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e788bb9d-5f1c-4c41-a51d-b7c6e3536b4a req-d17633bb-1e72-4121-ac06-77f281fdb181 tempest-TestShelveInstance-996076117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e788bb9d-5f1c-4c41-a51d-b7c6e3536b4a req-d17633bb-1e72-4121-ac06-77f281fdb181 tempest-TestShelveInstance-996076117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e788bb9d-5f1c-4c41-a51d-b7c6e3536b4a req-d17633bb-1e72-4121-ac06-77f281fdb181 tempest-TestShelveInstance-996076117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e788bb9d-5f1c-4c41-a51d-b7c6e3536b4a req-d17633bb-1e72-4121-ac06-77f281fdb181 tempest-TestShelveInstance-996076117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-00968453-4763-40bf-8718-e37f5cb32bcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a246d6ba-dbad-468f-96ef-6889b30b00f3', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:16:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e788bb9d-5f1c-4c41-a51d-b7c6e3536b4a req-d17633bb-1e72-4121-ac06-77f281fdb181 tempest-TestShelveInstance-996076117 None] attachment_update completed successfully. Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Creating offline snapshot 7d73795e-3b5f-4a15-996d-0787dd838b65 of volume 51407910-a84d-4895-b765-db709843d57f {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d711c96-bdfa-4e1a-aed8-2e5058b60407]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:45 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15" returned: 0 in 0.729s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:45 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15 Sep 28 15:16:45 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:45 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f Sep 28 15:16:45 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:46 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744.02bc0a96-6718-453d-aa67-79ea69aeec15" returned: 0 in 0.540s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:46 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f" returned: 0 in 0.788s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-02bc0a96-6718-453d-aa67-79ea69aeec15" released by "_delete_snapshot" :: held 3.109s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:46 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 1G Sep 28 15:16:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-7bf79ad9-6570-4643-a348-b64286d66744" released by "delete_snapshot" :: held 3.188s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:46 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:46 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Created reservations ['2546b990-a54f-40bd-b9f2-c35451ef5c92', '5aab9463-eab9-47dd-af8d-9e69efaaa9cf', '1e57019e-214f-4979-99a9-45b12c45a104', 'f6e31644-853d-4dc4-802d-3daae35c3952'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Delete snapshot completed successfully. Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aadcfbde-cf9f-46bd-8c86-95fa829cc066 tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-02bc0a96-6718-453d-aa67-79ea69aeec15-delete_snapshot" released by "delete_snapshot" :: held 3.832s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:47 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:16:47 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:47 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 1G" returned: 0 in 1.105s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51407910-a84d-4895-b765-db709843d57f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:47 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51407910-a84d-4895-b765-db709843d57f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 Sep 28 15:16:47 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-7bf79ad9-6570-4643-a348-b64286d66744-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-7bf79ad9-6570-4643-a348-b64286d66744-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:47 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.622s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:16:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:16:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-quobyte-7bf79ad9-6570-4643-a348-b64286d66744" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-7bf79ad9-6570-4643-a348-b64286d66744" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:48 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc8aec-d9c5-4eab-9c8d-0e9552835028]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:48 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51407910-a84d-4895-b765-db709843d57f -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65" returned: 0 in 1.103s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:48 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 is being set with open permissions: ugo+rw Sep 28 15:16:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:48 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 Sep 28 15:16:48 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:48 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 Sep 28 15:16:48 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:49 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744" returned: 0 in 1.080s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:49 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65" returned: 0 in 0.857s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:49 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744 Sep 28 15:16:49 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:49 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.info Sep 28 15:16:49 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:49 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7bf79ad9-6570-4643-a348-b64286d66744" returned: 0 in 0.708s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-7bf79ad9-6570-4643-a348-b64286d66744" released by "delete_volume" :: held 2.020s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:50 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.info" returned: 0 in 0.540s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:50 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.info is being set with open permissions: ugo+rw Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:50 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.info Sep 28 15:16:50 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Created reservations ['f5191704-426a-4fc5-bbfb-65e08d929141', '1f028b08-dedf-4a44-9637-59097c34bb7f', '557d145a-3a4e-487a-a2c1-9331576572d3', 'a8f2ad28-75ec-4bbb-b5e1-f617b85f0245'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:50 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:16:50 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:50 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.info" returned: 0 in 0.624s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.317s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-23915c02-3a3d-46e5-8694-3908d8d0ecee tempest-CreateVolumesFromSnapshotTest-2063437053 None] Create snapshot completed successfully Sep 28 15:16:50 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.364s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:50 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Deleted volume successfully. Sep 28 15:16:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c74e1db1-6e83-4c49-a711-b62b94eec34b tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-7bf79ad9-6570-4643-a348-b64286d66744-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-f0b20167-677e-440b-8ad7-5ef4c2111ab6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-f0b20167-677e-440b-8ad7-5ef4c2111ab6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "cinder-quobyte-f0b20167-677e-440b-8ad7-5ef4c2111ab6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:16:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-f0b20167-677e-440b-8ad7-5ef4c2111ab6" acquired by "delete_volume" :: waited 0.056s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:16:51 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b91c7a-b132-4bb0-b46e-741dfce4ca87]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:16:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:52 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 Sep 28 15:16:52 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (708e2612-3e3a-4f4a-9473-3371ba8634e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82315af-3dfe-4d6d-81c1-6ba7fde460ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82315af-3dfe-4d6d-81c1-6ba7fde460ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451351658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d805d53-59a9-4c44-bbf1-4a33ce72ee72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:52Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958942fb-b097-42fe-8ea3-1f5f441f2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958942fb-b097-42fe-8ea3-1f5f441f2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c577328e-f3f9-44c4-b487-bdee6feea5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c577328e-f3f9-44c4-b487-bdee6feea5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d805d53-59a9-4c44-bbf1-4a33ce72ee72', 'volume_name': 'volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba98155-0ad3-43da-8c47-8e1ab31f5d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba98155-0ad3-43da-8c47-8e1ab31f5d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572309a9-1123-428c-801d-8a74743de3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume 3d805d53-59a9-4c44-bbf1-4a33ce72ee72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72', 'volume_size': 1} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451351658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d805d53-59a9-4c44-bbf1-4a33ce72ee72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:52Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Creating volume 3d805d53-59a9-4c44-bbf1-4a33ce72ee72 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:52 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:52 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 1073741824 Sep 28 15:16:52 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:52 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6" returned: 0 in 1.166s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:53 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6 Sep 28 15:16:53 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (32f57b75-bd9d-4ccc-8ac0-a63d5d5e4e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb28cde-4a7d-47f7-81d7-2dd92bb79538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb28cde-4a7d-47f7-81d7-2dd92bb79538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95054031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:53Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef99656-a4fe-49d3-b07a-9c13c9a6ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef99656-a4fe-49d3-b07a-9c13c9a6ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24664f3-4b16-44ff-b02b-32258652b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24664f3-4b16-44ff-b02b-32258652b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a', 'volume_name': 'volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1f233f-f0b6-4eb9-8cda-64e5bbaa5e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1f233f-f0b6-4eb9-8cda-64e5bbaa5e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449d4554-c5c4-45ac-8484-3e43b6ded867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:53 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume 0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a', 'volume_size': 1} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 1073741824" returned: 0 in 1.207s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:53 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:53 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 Sep 28 15:16:53 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:54 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f0b20167-677e-440b-8ad7-5ef4c2111ab6" returned: 0 in 1.261s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-quobyte-f0b20167-677e-440b-8ad7-5ef4c2111ab6" released by "delete_volume" :: held 2.591s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Created reservations ['3a6bfebe-1bfe-4a04-a96f-47aeeb7305dd', '5311be8e-d70a-4cfc-b357-316326e0c8cf', '47c10a78-5a8d-4b09-b87b-bdc07561dded', '718880b9-9480-483a-ad8d-41c9936b581b'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:54 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:16:54 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:54 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72" returned: 0 in 1.213s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.585s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95054031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:53Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Creating volume 0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:55 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:55 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a 1073741824 Sep 28 15:16:55 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572309a9-1123-428c-801d-8a74743de3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc638330-a694-4872-9e0a-c1d692d587df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:55 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:55 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 (3d805d53-59a9-4c44-bbf1-4a33ce72ee72): created successfully Sep 28 15:16:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc638330-a694-4872-9e0a-c1d692d587df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (708e2612-3e3a-4f4a-9473-3371ba8634e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 1.427s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:16:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Deleted volume successfully. Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (e2c3b0e8-a706-4f61-875b-935b3d8596e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03008ddd-b63f-41e7-a9ce-6820d912c1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a105e0c7-7e9c-4934-a093-b313e31b580a tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created volume successfully. Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bd942837-1c46-41f5-bdea-7a88fe2b62df tempest-SnapshotDependencyTests-1867179221 None] Lock "cinder-f0b20167-677e-440b-8ad7-5ef4c2111ab6-delete_volume" released by "delete_volume" :: held 4.966s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03008ddd-b63f-41e7-a9ce-6820d912c1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361483937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60154679-b144-47eb-97c2-f24ac816869f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:55Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62dbd2c-1450-4282-85ac-4b3a9e49b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62dbd2c-1450-4282-85ac-4b3a9e49b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9723b65-3268-4ed7-9bc5-8a98fe80e4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:56 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9723b65-3268-4ed7-9bc5-8a98fe80e4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60154679-b144-47eb-97c2-f24ac816869f', 'volume_name': 'volume-60154679-b144-47eb-97c2-f24ac816869f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c72374-c426-4d20-a14b-4eaf3cc84fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c72374-c426-4d20-a14b-4eaf3cc84fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ed8b8f-1dd3-442a-8030-7339de249330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:56 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume 60154679-b144-47eb-97c2-f24ac816869f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60154679-b144-47eb-97c2-f24ac816869f', 'volume_size': 1} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a 1073741824" returned: 0 in 1.850s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (0d04ff00-eaca-495b-8edc-203e0e099d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752cd49b-251d-405c-95b3-cc6064496b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:57 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a Sep 28 15:16:57 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752cd49b-251d-405c-95b3-cc6064496b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-586186619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b4d52-8c3b-4b82-8573-2237b48619c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:57Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43341cd2-40f8-4905-8e9f-6da96d98949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43341cd2-40f8-4905-8e9f-6da96d98949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccc33a3-b8f4-4d40-bcae-08519cb0e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccc33a3-b8f4-4d40-bcae-08519cb0e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0b4d52-8c3b-4b82-8573-2237b48619c0', 'volume_name': 'volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc15384-d938-473b-a4a9-d555d0b84b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc15384-d938-473b-a4a9-d555d0b84b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7a6d82-94d0-4ea4-b1f0-7cd157d5a028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume 6b0b4d52-8c3b-4b82-8573-2237b48619c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0', 'volume_size': 1} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:57 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a" returned: 0 in 0.669s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] <== create_volume: return (2765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.777s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.924s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-361483937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60154679-b144-47eb-97c2-f24ac816869f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:55Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Creating volume 60154679-b144-47eb-97c2-f24ac816869f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:16:57 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:16:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:57 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f 1073741824 Sep 28 15:16:57 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449d4554-c5c4-45ac-8484-3e43b6ded867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cb683b-593b-4017-b5cc-492309bd17c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a (0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a): created successfully Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cb683b-593b-4017-b5cc-492309bd17c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (32f57b75-bd9d-4ccc-8ac0-a63d5d5e4e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4740bb6d-9223-472d-97ee-405344733992 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created volume successfully. Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (f0222a3f-886e-4a3d-89ac-9b97052834b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373115a2-151f-469e-afc5-1e754ab20d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373115a2-151f-469e-afc5-1e754ab20d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558813266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bcc9fd-319a-4173-aa2a-6e090a400385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:58Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d589c23-7b71-45c8-96eb-9754e6c443d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d589c23-7b71-45c8-96eb-9754e6c443d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d63b87-e26a-49d6-b841-fb3e20b76698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d63b87-e26a-49d6-b841-fb3e20b76698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bcc9fd-319a-4173-aa2a-6e090a400385', 'volume_name': 'volume-94bcc9fd-319a-4173-aa2a-6e090a400385', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c698886-7aba-4325-ab34-f35394585fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c698886-7aba-4325-ab34-f35394585fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cccdfa-7f41-4177-9596-70828fbe01bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:16:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume 94bcc9fd-319a-4173-aa2a-6e090a400385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bcc9fd-319a-4173-aa2a-6e090a400385', 'volume_size': 1} Sep 28 15:16:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:16:59 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Sep 28 15:16:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f 1073741824" returned: 0 in 1.709s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:16:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:16:59 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f Sep 28 15:16:59 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:00 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f" returned: 0 in 0.863s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.784s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.084s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-586186619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b4d52-8c3b-4b82-8573-2237b48619c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:57Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Creating volume 6b0b4d52-8c3b-4b82-8573-2237b48619c0 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:00 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ed8b8f-1dd3-442a-8030-7339de249330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60154679-b144-47eb-97c2-f24ac816869f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88afeac8-b2f7-4271-aec0-d425fbeb2009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:00 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 1073741824 Sep 28 15:17:00 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume volume-60154679-b144-47eb-97c2-f24ac816869f (60154679-b144-47eb-97c2-f24ac816869f): created successfully Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88afeac8-b2f7-4271-aec0-d425fbeb2009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (e2c3b0e8-a706-4f61-875b-935b3d8596e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-efcbb150-655f-4f61-81c3-2bce66452919 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created volume successfully. Sep 28 15:17:02 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 1073741824" returned: 0 in 1.368s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:02 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 Sep 28 15:17:02 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:03 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0" returned: 0 in 1.077s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] <== create_volume: return (2647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.666s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.421s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-558813266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bcc9fd-319a-4173-aa2a-6e090a400385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc43e4f670048f3a97bf41fa1126fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:16:58Z,use_quota=True,user_id='bf9b96f7c7d54a0e9031dfe8aecee2f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Creating volume 94bcc9fd-319a-4173-aa2a-6e090a400385 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:03 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7a6d82-94d0-4ea4-b1f0-7cd157d5a028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619331e1-031b-4cb1-abde-be31c219c3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:03 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 (6b0b4d52-8c3b-4b82-8573-2237b48619c0): created successfully Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619331e1-031b-4cb1-abde-be31c219c3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (0d04ff00-eaca-495b-8edc-203e0e099d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:03 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 1073741824 Sep 28 15:17:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a59e2a3e-dfa6-4cf5-8e8f-03b4c2f122d1 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created volume successfully. Sep 28 15:17:03 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:04 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 1073741824" returned: 0 in 1.115s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:04 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 Sep 28 15:17:04 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:05 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385" returned: 0 in 0.609s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cccdfa-7f41-4177-9596-70828fbe01bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bcc9fd-319a-4173-aa2a-6e090a400385', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450db047-0b1c-4cbc-8779-f1001b90a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:05 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Volume volume-94bcc9fd-319a-4173-aa2a-6e090a400385 (94bcc9fd-319a-4173-aa2a-6e090a400385): created successfully Sep 28 15:17:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450db047-0b1c-4cbc-8779-f1001b90a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Flow 'volume_create_manager' (f0222a3f-886e-4a3d-89ac-9b97052834b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b6f8f768-5311-4720-986b-938070126649 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created volume successfully. Sep 28 15:17:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-94bcc9fd-319a-4173-aa2a-6e090a400385-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-94bcc9fd-319a-4173-aa2a-6e090a400385-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-94bcc9fd-319a-4173-aa2a-6e090a400385" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-94bcc9fd-319a-4173-aa2a-6e090a400385" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8415c38-7527-4fa4-b94e-5e467b7c5e70]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:06 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 Sep 28 15:17:06 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:07 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385" returned: 0 in 0.785s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:07 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385 Sep 28 15:17:07 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:07 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-94bcc9fd-319a-4173-aa2a-6e090a400385" returned: 0 in 0.498s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-94bcc9fd-319a-4173-aa2a-6e090a400385" released by "delete_volume" :: held 1.382s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created reservations ['cd0256aa-1ac1-4b53-ad04-09313b985c8f', '2eed28ee-e18e-4d86-9bd9-2e640c25fd21', '5b796c27-2bfc-4939-829b-b29b561c3e26', 'fb38bb17-303f-4123-b978-0584f400adab'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:08 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:08 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-6b0b4d52-8c3b-4b82-8573-2237b48619c0-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:08 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.659s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:08 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Deleted volume successfully. Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-6b0b4d52-8c3b-4b82-8573-2237b48619c0-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-916d6641-0343-43d8-a846-020b2945047f tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-94bcc9fd-319a-4173-aa2a-6e090a400385-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-6b0b4d52-8c3b-4b82-8573-2237b48619c0" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-6b0b4d52-8c3b-4b82-8573-2237b48619c0" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db56e39-ac60-4b68-9bbe-0be7ddf18ace]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:09 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 Sep 28 15:17:09 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:09 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0" returned: 0 in 0.660s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:09 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0 Sep 28 15:17:09 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b0b4d52-8c3b-4b82-8573-2237b48619c0" returned: 0 in 0.564s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-6b0b4d52-8c3b-4b82-8573-2237b48619c0" released by "delete_volume" :: held 1.294s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created reservations ['7461a9b8-e5d8-4eeb-a644-f1fd4895929a', '1aa58d8a-8807-4f37-8bd7-4d0edfb028ae', '5c34a444-2523-49cc-9458-16353d405bc0', '542cfb06-3f77-496b-89b4-94570062aa33'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:10 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:10 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:10 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.472s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:10 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Deleted volume successfully. Sep 28 15:17:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-76ab99ac-8e60-41f0-b9cf-ea657e1a5e47 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-6b0b4d52-8c3b-4b82-8573-2237b48619c0-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-60154679-b144-47eb-97c2-f24ac816869f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-60154679-b144-47eb-97c2-f24ac816869f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-60154679-b144-47eb-97c2-f24ac816869f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:11 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-60154679-b144-47eb-97c2-f24ac816869f" acquired by "delete_volume" :: waited 0.040s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:11 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[057138f8-7eb7-4ee2-b4ac-1079e3710f70]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:11 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f Sep 28 15:17:11 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f" returned: 0 in 0.930s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:12 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f Sep 28 15:17:12 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:12 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-60154679-b144-47eb-97c2-f24ac816869f" returned: 0 in 0.562s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-60154679-b144-47eb-97c2-f24ac816869f" released by "delete_volume" :: held 1.587s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created reservations ['f019ce23-64ec-417b-9c49-09f83a6e983e', '95b7225e-2eda-4f4c-8c89-389e671772aa', 'de94fff7-6e8e-4a90-a03d-08e81d81aade', '97de5629-edd2-4b8f-a9c6-0955695e5282'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:13 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:13 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:13 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.569s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Deleted volume successfully. Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-19bb9de0-e002-4ffe-a680-1ecdbdcb7744 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-60154679-b144-47eb-97c2-f24ac816869f-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e3c4eb-2e3c-4665-8849-9df401d09896]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:14 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a Sep 28 15:17:14 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:14 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a" returned: 0 in 0.616s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:14 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a Sep 28 15:17:14 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:15 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a" returned: 0 in 0.726s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a" released by "delete_volume" :: held 1.444s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created reservations ['9435ce57-f447-4282-b928-ef2d42f608dc', '778f3c37-9d48-4ff4-9229-6a18d6dcb791', 'd803e37a-42c0-49ec-8242-0756b577b975', '8b01afd3-8a21-4abf-ad3f-8eaa90750f7a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:15 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:15 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-3d805d53-59a9-4c44-bbf1-4a33ce72ee72-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:16 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.663s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-3d805d53-59a9-4c44-bbf1-4a33ce72ee72-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Deleted volume successfully. Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d8713d21-4488-4fe3-8137-312a4f93c531 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-0bc034ea-8a5a-43d7-ad4c-5c1a1b6ac17a-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-3d805d53-59a9-4c44-bbf1-4a33ce72ee72" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-3d805d53-59a9-4c44-bbf1-4a33ce72ee72" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d1d3a2-0622-45d4-a1f2-20ff8e0859b9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:17 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 Sep 28 15:17:17 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:17 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72" returned: 0 in 0.965s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:17 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72 Sep 28 15:17:17 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:18 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3d805d53-59a9-4c44-bbf1-4a33ce72ee72" returned: 0 in 0.816s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-3d805d53-59a9-4c44-bbf1-4a33ce72ee72" released by "delete_volume" :: held 1.878s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:18 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created reservations ['51804b2a-2a07-403e-9cb7-58e3ab5a2545', 'c9b044d9-393e-40b6-b7aa-1ae9dcec7a2d', 'f14bccd8-85f8-48b9-99d6-c8defcb4ed2b', '95cae37a-64d0-49cf-bd8a-0721a14bf3ec'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:19 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:19 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-7d73795e-3b5f-4a15-996d-0787dd838b65-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-7d73795e-3b5f-4a15-996d-0787dd838b65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-51407910-a84d-4895-b765-db709843d57f" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-51407910-a84d-4895-b765-db709843d57f" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-7d73795e-3b5f-4a15-996d-0787dd838b65" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-7d73795e-3b5f-4a15-996d-0787dd838b65" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Deleting offline snapshot 7d73795e-3b5f-4a15-996d-0787dd838b65 of volume 51407910-a84d-4895-b765-db709843d57f {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] snapshot_file for this snap is: volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8837197b-62da-452c-8720-bcbc52786bdd]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=86,cinder:UPDATE=94,cinder:DELETE=7,cinder:INSERT=30 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:19 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 Sep 28 15:17:19 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Flow 'volume_create_manager' (ed344f4a-744e-4118-b77a-9629a638eec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc5dd05-f402-4f4b-9273-ecec82ca40e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc5dd05-f402-4f4b-9273-ecec82ca40e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1483736650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d425975b3ce434cb1b3ebe2dfa9610c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:20Z,use_quota=True,user_id='430c4ddd7f5746c2b68c2b55b1af8ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7352049f-cb4f-438b-a663-457af56913e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7352049f-cb4f-438b-a663-457af56913e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944bdd2a-64e8-4c61-8a5d-558e074fb125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944bdd2a-64e8-4c61-8a5d-558e074fb125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8', 'volume_name': 'volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19903bc8-cf2f-41e8-b43d-23f9e1e0405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19903bc8-cf2f-41e8-b43d-23f9e1e0405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d0da54-c76c-473f-b4a2-f19fa365fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:19 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:19 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Volume 1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8', 'volume_size': 1} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1483736650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d425975b3ce434cb1b3ebe2dfa9610c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:20Z,use_quota=True,user_id='430c4ddd7f5746c2b68c2b55b1af8ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Creating volume 1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:19 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.837s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Deleted volume successfully. Sep 28 15:17:19 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 1073741824 Sep 28 15:17:19 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=97,cinder:SELECT=79,cinder:INSERT=26,cinder:DELETE=11 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:17:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-504d3997-4306-4368-901c-a89fb50ed7b9 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-3d805d53-59a9-4c44-bbf1-4a33ce72ee72-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:20 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65" returned: 0 in 0.845s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51407910-a84d-4895-b765-db709843d57f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc6c9f1-c19e-462c-a9dc-b7e9d436d576]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f Sep 28 15:17:20 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:20 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 1073741824" returned: 0 in 0.982s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:20 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 Sep 28 15:17:20 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f" returned: 0 in 0.611s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 Sep 28 15:17:21 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:21 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8" returned: 0 in 0.467s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d0da54-c76c-473f-b4a2-f19fa365fac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199a1051-7b7a-40ee-95b6-e172ba65baa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:21 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Volume volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 (1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8): created successfully Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199a1051-7b7a-40ee-95b6-e172ba65baa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Flow 'volume_create_manager' (ed344f4a-744e-4118-b77a-9629a638eec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-28f9d8de-ac20-4b28-8a84-b8bb10a5a573 tempest-AttachVolumeTestJSON-1980644169 None] Created volume successfully. Sep 28 15:17:21 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65" returned: 0 in 0.661s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:21 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65 Sep 28 15:17:21 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:22 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f.7d73795e-3b5f-4a15-996d-0787dd838b65" returned: 0 in 0.519s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-7d73795e-3b5f-4a15-996d-0787dd838b65" released by "_delete_snapshot" :: held 2.936s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-51407910-a84d-4895-b765-db709843d57f" released by "delete_snapshot" :: held 2.987s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created reservations ['351415e1-b38e-4d15-8eb2-33bfa4619761', '9dec78fc-ee7e-4377-9b77-946c608b28fb', '94049bf5-33b8-4359-bb1f-77551cdb80a6', '34f374b4-957a-4cbc-91ab-fe0f0a43737f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Delete snapshot completed successfully. Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-0084a53e-d7fd-44a5-b77c-c4312d25d400 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-7d73795e-3b5f-4a15-996d-0787dd838b65-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-51407910-a84d-4895-b765-db709843d57f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-51407910-a84d-4895-b765-db709843d57f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "cinder-quobyte-51407910-a84d-4895-b765-db709843d57f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-51407910-a84d-4895-b765-db709843d57f" acquired by "delete_volume" :: waited 0.028s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e27053-81b7-4d33-b6f1-7fb934393193]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:23 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f Sep 28 15:17:23 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:23 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f" returned: 0 in 0.757s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-cd078f72-831e-4088-881a-1c8bf1986763 req-d3b2ed2d-fcf8-445e-9aa8-66290debd5e3 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-cd078f72-831e-4088-881a-1c8bf1986763 req-d3b2ed2d-fcf8-445e-9aa8-66290debd5e3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:23 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f Sep 28 15:17:23 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-cd078f72-831e-4088-881a-1c8bf1986763 req-d3b2ed2d-fcf8-445e-9aa8-66290debd5e3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-cd078f72-831e-4088-881a-1c8bf1986763 req-d3b2ed2d-fcf8-445e-9aa8-66290debd5e3 tempest-AttachVolumeTestJSON-1980644169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2ea570c-8d92-468e-953e-3beec36ea46a', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:17:23 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-cd078f72-831e-4088-881a-1c8bf1986763 req-d3b2ed2d-fcf8-445e-9aa8-66290debd5e3 tempest-AttachVolumeTestJSON-1980644169 None] attachment_update completed successfully. Sep 28 15:17:24 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-51407910-a84d-4895-b765-db709843d57f" returned: 0 in 0.438s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-quobyte-51407910-a84d-4895-b765-db709843d57f" released by "delete_volume" :: held 1.309s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Created reservations ['96471232-0aee-4718-bcba-9f8484700bca', '4f284cb7-0a2d-4874-986f-5c97e6b5380c', '1eb26dc2-5d78-4b10-bca0-e301fabbd09d', 'e2471045-7807-4cf7-a215-2612ed2fb52d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:24 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:24 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:24 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.456s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Deleted volume successfully. Sep 28 15:17:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-245f1b8a-8a9f-4dde-a1a0-ccc1ef3e2b86 tempest-CreateVolumesFromSnapshotTest-2063437053 None] Lock "cinder-51407910-a84d-4895-b765-db709843d57f-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Flow 'volume_create_manager' (1c2cf479-c022-42e0-88ad-f6352a0700e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2415d1a4-9b0e-4e2d-845d-66f021bfa23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2415d1a4-9b0e-4e2d-845d-66f021bfa23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-40077749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e6b7d0-816f-46e0-831d-26e798c8f0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d425975b3ce434cb1b3ebe2dfa9610c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:26Z,use_quota=True,user_id='430c4ddd7f5746c2b68c2b55b1af8ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc7c7d2-1518-4616-9af3-7f864fa986ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc7c7d2-1518-4616-9af3-7f864fa986ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f288454-49f7-4859-89a4-1789572b2b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f288454-49f7-4859-89a4-1789572b2b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87e6b7d0-816f-46e0-831d-26e798c8f0d3', 'volume_name': 'volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ec2600-7663-4ca0-a93e-78514829896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ec2600-7663-4ca0-a93e-78514829896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d732a455-d394-425a-b55d-288db0f17217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:26 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Volume 87e6b7d0-816f-46e0-831d-26e798c8f0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3', 'volume_size': 1} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-40077749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87e6b7d0-816f-46e0-831d-26e798c8f0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d425975b3ce434cb1b3ebe2dfa9610c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:26Z,use_quota=True,user_id='430c4ddd7f5746c2b68c2b55b1af8ac7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Creating volume 87e6b7d0-816f-46e0-831d-26e798c8f0d3 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:26 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:17:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:26 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 1073741824 Sep 28 15:17:26 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:27 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 1073741824" returned: 0 in 0.714s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:27 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 Sep 28 15:17:27 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:27 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3" returned: 0 in 0.342s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d732a455-d394-425a-b55d-288db0f17217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a142a0-b9c4-4595-bd91-c855c50cc1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:27 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Volume volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 (87e6b7d0-816f-46e0-831d-26e798c8f0d3): created successfully Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a142a0-b9c4-4595-bd91-c855c50cc1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Flow 'volume_create_manager' (1c2cf479-c022-42e0-88ad-f6352a0700e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4202f005-28a4-4f87-bb68-2fc3a6dbf898 tempest-AttachVolumeTestJSON-1980644169 None] Created volume successfully. Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Flow 'volume_create_manager' (6106070d-4057-46b2-848c-6ed37a1ded78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f91fb9-f6a4-4f8f-8c54-23391ded7490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f91fb9-f6a4-4f8f-8c54-23391ded7490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c66195-1b22-4498-b970-33557c8067db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233ccc0970e24466b1e3c26caef867b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:30Z,use_quota=True,user_id='d36d63cacc394fa785be2cb5291cd8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f38c616-f69a-4b3a-bfcd-a7975ac4bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f38c616-f69a-4b3a-bfcd-a7975ac4bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee275aa-d4d8-4a05-9910-d6b1ba3fff54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee275aa-d4d8-4a05-9910-d6b1ba3fff54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c66195-1b22-4498-b970-33557c8067db', 'volume_name': 'volume-90c66195-1b22-4498-b970-33557c8067db', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2b1e27-b690-497c-b267-2985e577f8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2b1e27-b690-497c-b267-2985e577f8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7485d72-5f19-403d-a433-76d6d65be959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Volume 90c66195-1b22-4498-b970-33557c8067db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c66195-1b22-4498-b970-33557c8067db', 'volume_size': 1} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c66195-1b22-4498-b970-33557c8067db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233ccc0970e24466b1e3c26caef867b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:30Z,use_quota=True,user_id='d36d63cacc394fa785be2cb5291cd8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Creating volume 90c66195-1b22-4498-b970-33557c8067db {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:29 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:29 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db 1073741824 Sep 28 15:17:29 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-de092d9d-221c-4af8-9b25-b8d1931737fe req-90a1101a-4cca-429e-8163-bb925022e2aa tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:30 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db 1073741824" returned: 0 in 0.713s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:30 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db Sep 28 15:17:30 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:30 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db" returned: 0 in 0.283s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-de092d9d-221c-4af8-9b25-b8d1931737fe req-90a1101a-4cca-429e-8163-bb925022e2aa tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.998s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7485d72-5f19-403d-a433-76d6d65be959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c66195-1b22-4498-b970-33557c8067db', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6087e53c-35c7-4d51-8dbb-fcd771eb8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-de092d9d-221c-4af8-9b25-b8d1931737fe req-90a1101a-4cca-429e-8163-bb925022e2aa tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Volume volume-90c66195-1b22-4498-b970-33557c8067db (90c66195-1b22-4498-b970-33557c8067db): created successfully Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6087e53c-35c7-4d51-8dbb-fcd771eb8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Flow 'volume_create_manager' (6106070d-4057-46b2-848c-6ed37a1ded78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-916fc6bd-586e-4c7a-b7fd-183104c3b578 tempest-CinderUnicodeTest-515506332 None] Created volume successfully. Sep 28 15:17:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-de092d9d-221c-4af8-9b25-b8d1931737fe req-90a1101a-4cca-429e-8163-bb925022e2aa tempest-AttachVolumeTestJSON-1980644169 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71bac006-55bd-493a-a0a1-a577d4ce16a7', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:17:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-de092d9d-221c-4af8-9b25-b8d1931737fe req-90a1101a-4cca-429e-8163-bb925022e2aa tempest-AttachVolumeTestJSON-1980644169 None] attachment_update completed successfully. Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Flow 'volume_create_manager' (a416bc21-4b32-4f9e-b19d-4bba4a4675bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa55be57-7c13-47e2-9b3d-92066808f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa55be57-7c13-47e2-9b3d-92066808f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-930010685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65f3a64-ce2b-4231-b1c5-7327731a7bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233ccc0970e24466b1e3c26caef867b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:33Z,use_quota=True,user_id='d36d63cacc394fa785be2cb5291cd8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626a7589-488c-47dc-84f8-fb3c574c5f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626a7589-488c-47dc-84f8-fb3c574c5f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6aafc7-2a73-4839-a4f4-b67752ab2709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6aafc7-2a73-4839-a4f4-b67752ab2709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65f3a64-ce2b-4231-b1c5-7327731a7bf6', 'volume_name': 'volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415d4678-2862-4d69-8fcd-9fe826fd1380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415d4678-2862-4d69-8fcd-9fe826fd1380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73402591-f629-415d-90f6-12c0f83d551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Volume f65f3a64-ce2b-4231-b1c5-7327731a7bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6', 'volume_size': 1} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:17:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-930010685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65f3a64-ce2b-4231-b1c5-7327731a7bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233ccc0970e24466b1e3c26caef867b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:17:33Z,use_quota=True,user_id='d36d63cacc394fa785be2cb5291cd8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Creating volume f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:17:32 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:17:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:32 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 1073741824 Sep 28 15:17:32 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:33 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 1073741824" returned: 0 in 0.721s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:33 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 Sep 28 15:17:33 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:33 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" returned: 0 in 0.413s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:17:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73402591-f629-415d-90f6-12c0f83d551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d677cd-9ceb-4073-be3f-8feacf16d582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:17:33 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Volume volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 (f65f3a64-ce2b-4231-b1c5-7327731a7bf6): created successfully Sep 28 15:17:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d677cd-9ceb-4073-be3f-8feacf16d582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:17:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Flow 'volume_create_manager' (a416bc21-4b32-4f9e-b19d-4bba4a4675bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:17:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bccf6755-350b-4cfb-b73c-216cb6e6eebb tempest-CinderUnicodeTest-515506332 None] Created volume successfully. Sep 28 15:17:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-16205d82-9d82-46a5-98d1-cbf39bd85399 req-c97a5b4b-4037-4449-af45-c24ded62cfa6 tempest-AttachVolumeTestJSON-1980644169 None] Terminate volume connection completed successfully. Sep 28 15:17:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-16205d82-9d82-46a5-98d1-cbf39bd85399 req-c97a5b4b-4037-4449-af45-c24ded62cfa6 tempest-AttachVolumeTestJSON-1980644169 None] Deleting attachment f2ea570c-8d92-468e-953e-3beec36ea46a. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Creating offline snapshot 131e779b-cf0c-451c-b275-2bd2c426117c of volume f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c98eef-7ec1-435a-918a-f8e0417a256b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:35 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 Sep 28 15:17:35 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:35 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" returned: 0 in 0.617s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:35 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c 1G Sep 28 15:17:35 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-af78fae5-e6ec-48e8-9056-f3f796022177 req-a9335f80-a887-4c3b-9a35-7a63dff9e7ec tempest-AttachVolumeTestJSON-1980644169 None] Terminate volume connection completed successfully. Sep 28 15:17:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-af78fae5-e6ec-48e8-9056-f3f796022177 req-a9335f80-a887-4c3b-9a35-7a63dff9e7ec tempest-AttachVolumeTestJSON-1980644169 None] Deleting attachment 71bac006-55bd-493a-a0a1-a577d4ce16a7. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:36 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c 1G" returned: 0 in 0.770s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:36 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c Sep 28 15:17:36 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:37 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c" returned: 0 in 0.461s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:37 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c is being set with open permissions: ugo+rw Sep 28 15:17:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:37 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c Sep 28 15:17:37 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:37 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c" returned: 0 in 0.434s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:37 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.info Sep 28 15:17:37 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:38 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.info" returned: 0 in 0.699s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:38 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.info is being set with open permissions: ugo+rw Sep 28 15:17:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:38 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.info Sep 28 15:17:38 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-f6058d7a-0a37-4309-bf5d-164faec88019 req-78e6ee9a-a815-4515-8f73-7a890716f9f9 tempest-TestShelveInstance-996076117 None] Terminate volume connection completed successfully. Sep 28 15:17:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-f6058d7a-0a37-4309-bf5d-164faec88019 req-78e6ee9a-a815-4515-8f73-7a890716f9f9 tempest-TestShelveInstance-996076117 None] Deleting attachment a246d6ba-dbad-468f-96ef-6889b30b00f3. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:17:39 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.info" returned: 0 in 0.655s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.833s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fdd7d4c2-5e5b-459c-86b0-a2df9561b578 tempest-CinderUnicodeTest-515506332 None] Create snapshot completed successfully Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "cinder-131e779b-cf0c-451c-b275-2bd2c426117c-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-131e779b-cf0c-451c-b275-2bd2c426117c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "cinder-quobyte-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "cinder-quobyte-131e779b-cf0c-451c-b275-2bd2c426117c" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-131e779b-cf0c-451c-b275-2bd2c426117c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Deleting offline snapshot 131e779b-cf0c-451c-b275-2bd2c426117c of volume f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] snapshot_file for this snap is: volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b2c63-7ac9-42bf-bbcd-0991c53b9da6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:40 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c Sep 28 15:17:40 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:40 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c" returned: 0 in 0.637s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:17:40 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9b30cb-93c2-4f93-bb47-d6c1e82f7145]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:40 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 Sep 28 15:17:40 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:41 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" returned: 0 in 0.779s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:41 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c Sep 28 15:17:41 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:41 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c" returned: 0 in 0.590s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:42 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c Sep 28 15:17:42 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:42 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6.131e779b-cf0c-451c-b275-2bd2c426117c" returned: 0 in 0.343s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-131e779b-cf0c-451c-b275-2bd2c426117c" released by "_delete_snapshot" :: held 2.553s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" released by "delete_snapshot" :: held 2.592s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:42 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Created reservations ['224801d7-98ff-4202-a61b-a37f8ae8dde2', '53e92cb9-6eab-47b6-a696-af6a3ac2818c', '0dd33a7c-7f2a-48b4-843a-662bb5719c04', 'df513400-cfd9-43a6-9117-f67adb7f6d6f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:42 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Delete snapshot completed successfully. Sep 28 15:17:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3528333c-a75e-4994-a190-26e103c759c7 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-131e779b-cf0c-451c-b275-2bd2c426117c-delete_snapshot" released by "delete_snapshot" :: held 2.809s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Acquiring lock "cinder-f65f3a64-ce2b-4231-b1c5-7327731a7bf6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Lock "cinder-f65f3a64-ce2b-4231-b1c5-7327731a7bf6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Acquiring lock "cinder-quobyte-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1201a7-3695-4fba-a88c-928f225fb338]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-cb917ce7-014a-4168-9f96-38fe264bb714 req-d6dc5901-4d42-4229-adac-5b65a0bada2f tempest-TestShelveInstance-996076117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-cb917ce7-014a-4168-9f96-38fe264bb714 req-d6dc5901-4d42-4229-adac-5b65a0bada2f tempest-TestShelveInstance-996076117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-cb917ce7-014a-4168-9f96-38fe264bb714 req-d6dc5901-4d42-4229-adac-5b65a0bada2f tempest-TestShelveInstance-996076117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:43 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 Sep 28 15:17:43 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-cb917ce7-014a-4168-9f96-38fe264bb714 req-d6dc5901-4d42-4229-adac-5b65a0bada2f tempest-TestShelveInstance-996076117 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-00968453-4763-40bf-8718-e37f5cb32bcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9eb6c0d-7b93-4986-b9b8-73914da5a7fe', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:17:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-cb917ce7-014a-4168-9f96-38fe264bb714 req-d6dc5901-4d42-4229-adac-5b65a0bada2f tempest-TestShelveInstance-996076117 None] attachment_update completed successfully. Sep 28 15:17:43 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" returned: 0 in 0.616s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6 Sep 28 15:17:44 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:44 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" returned: 0 in 0.440s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-f65f3a64-ce2b-4231-b1c5-7327731a7bf6" released by "delete_volume" :: held 1.188s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Created reservations ['993fea73-e893-4545-a921-667786c27877', '6b0c37aa-d086-4a51-85fe-2d5df2df4232', '41a1d7c6-f260-47d8-bdec-c0784b34e9f1', '0a9a2ec9-f4d4-425f-b0fa-0a030f4234e2'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "cinder-87e6b7d0-816f-46e0-831d-26e798c8f0d3-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-87e6b7d0-816f-46e0-831d-26e798c8f0d3-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:44 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:44 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "cinder-quobyte-87e6b7d0-816f-46e0-831d-26e798c8f0d3" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-quobyte-87e6b7d0-816f-46e0-831d-26e798c8f0d3" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c90dfe-54c2-48ba-8550-5b6a0d9edcf6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 Sep 28 15:17:45 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.358s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Deleted volume successfully. Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6759db6b-9aed-431d-a641-9cccbc356aaf tempest-CinderUnicodeTest-515506332 None] Lock "cinder-f65f3a64-ce2b-4231-b1c5-7327731a7bf6-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:45 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3" returned: 0 in 0.476s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3 Sep 28 15:17:45 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "cinder-90c66195-1b22-4498-b970-33557c8067db-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-90c66195-1b22-4498-b970-33557c8067db-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:45 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87e6b7d0-816f-46e0-831d-26e798c8f0d3" returned: 0 in 0.309s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-quobyte-87e6b7d0-816f-46e0-831d-26e798c8f0d3" released by "delete_volume" :: held 0.842s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "cinder-quobyte-90c66195-1b22-4498-b970-33557c8067db" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-90c66195-1b22-4498-b970-33557c8067db" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0aec28-aa7b-4255-aee3-4862e203ce1d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Created reservations ['1d4245a9-57df-485f-b365-e9a352828084', '9950c2d9-ca68-4c60-89ba-08fafb80ae42', '4fab0159-77ab-48c4-b000-f4ee0663fb78', 'e9ea6a04-64a8-44df-8a06-c17a87de8282'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:46 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:46 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:46 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db Sep 28 15:17:46 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:46 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.363s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Deleted volume successfully. Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a8640a8b-67de-4f51-bf95-b59fef7005e1 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-87e6b7d0-816f-46e0-831d-26e798c8f0d3-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:46 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db" returned: 0 in 0.706s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:46 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db Sep 28 15:17:46 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:46 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c66195-1b22-4498-b970-33557c8067db" returned: 0 in 0.351s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-quobyte-90c66195-1b22-4498-b970-33557c8067db" released by "delete_volume" :: held 1.131s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:46 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Created reservations ['0e0833fb-3e2c-47fb-bdeb-3136b5b37a07', '52788e5d-e8ef-432d-a24d-10f5b57583cd', '3e10b870-27e6-4e69-85b0-c40ded146970', '24f9ae70-6dba-4847-9145-5a1596edfc4e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:47 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:47 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "cinder-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:47 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:47 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "cinder-quobyte-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-quobyte-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a842c6-2a74-4d60-a04d-8eaf278278aa]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:47 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:47 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.618s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:47 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:47 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Deleted volume successfully. Sep 28 15:17:47 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.486s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ec151528-3d26-4eec-b6e9-c1f5bcf99eb2 tempest-CinderUnicodeTest-515506332 None] Lock "cinder-90c66195-1b22-4498-b970-33557c8067db-delete_volume" released by "delete_volume" :: held 2.188s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:17:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:17:48 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8" returned: 0 in 0.859s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:48 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8 Sep 28 15:17:48 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:49 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8" returned: 0 in 0.716s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-quobyte-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8" released by "delete_volume" :: held 1.721s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Created reservations ['f148eb4a-4d45-4b92-9a69-8247930c8322', '8eafa732-1cc6-42b4-8ef1-125a681b575a', '1faef0cb-ac6e-4744-a8e1-35f18103fe25', '00d2e9a3-53ec-4baa-8609-234a8552f2ac'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:49 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:49 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "cinder-414bc76b-1c26-4355-b822-7d0e0b5c35e4-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-414bc76b-1c26-4355-b822-7d0e0b5c35e4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:50 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.736s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Deleted volume successfully. Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "cinder-quobyte-414bc76b-1c26-4355-b822-7d0e0b5c35e4" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-quobyte-414bc76b-1c26-4355-b822-7d0e0b5c35e4" acquired by "delete_volume" :: waited 0.061s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f12483c-7f10-4a27-8494-88b82b9895c3 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-1176f4a6-ab64-43a8-882b-ed4f0d8eb4d8-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[79244118-f2ba-4572-b9ec-db242d60b73f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:17:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:50 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 Sep 28 15:17:50 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:51 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4" returned: 0 in 0.774s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:51 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4 Sep 28 15:17:51 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:51 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-414bc76b-1c26-4355-b822-7d0e0b5c35e4" returned: 0 in 0.438s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-quobyte-414bc76b-1c26-4355-b822-7d0e0b5c35e4" released by "delete_volume" :: held 1.304s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:17:51 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Created reservations ['85859c60-d1f4-47c0-b4da-3777fbf4aa44', 'f71dae17-cba7-40ab-a19c-cdbd35d1a788', '3576f39a-82c8-4a66-abbb-169b10bb5a34', 'c2f0e36c-270b-48a1-8320-c968de44303c'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:17:52 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:17:52 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:17:52 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.600s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:17:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Deleted volume successfully. Sep 28 15:17:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-34dac0cd-0dbb-4116-b154-115985328122 tempest-AttachVolumeTestJSON-1980644169 None] Lock "cinder-414bc76b-1c26-4355-b822-7d0e0b5c35e4-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:02 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=72,cinder:UPDATE=82,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:02 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=71,cinder:SELECT=76,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (544ebf89-1c99-4b02-85f6-40a383f2d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb90d17-83c7-41a7-9a86-08fda937d761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb90d17-83c7-41a7-9a86-08fda937d761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695988303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad39e6ba-9996-4142-9b74-563a6fa0fce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:05Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2fab5b-b056-4a3f-8dd5-cbd10acecaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2fab5b-b056-4a3f-8dd5-cbd10acecaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6850b0b-50ce-409c-a115-6e22317006cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6850b0b-50ce-409c-a115-6e22317006cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad39e6ba-9996-4142-9b74-563a6fa0fce8', 'volume_name': 'volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d923499-5f93-4f4e-b3dc-5f1614351ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d923499-5f93-4f4e-b3dc-5f1614351ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf14ae4-1dac-4e98-ab2a-6bbf12c41d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:05 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Volume ad39e6ba-9996-4142-9b74-563a6fa0fce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8', 'volume_size': 1} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-695988303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad39e6ba-9996-4142-9b74-563a6fa0fce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:05Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Creating volume ad39e6ba-9996-4142-9b74-563a6fa0fce8 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:05 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:18:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:05 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 1073741824 Sep 28 15:18:05 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:06 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 1073741824" returned: 0 in 0.870s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:06 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 Sep 28 15:18:06 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:06 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8" returned: 0 in 0.387s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf14ae4-1dac-4e98-ab2a-6bbf12c41d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c5e80f-e1d0-4027-9ea2-dffb25f9bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:06 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Volume volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 (ad39e6ba-9996-4142-9b74-563a6fa0fce8): created successfully Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c5e80f-e1d0-4027-9ea2-dffb25f9bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (544ebf89-1c99-4b02-85f6-40a383f2d08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5a69cbb2-df1a-4e84-8ad0-ba891c5a12de tempest-ProjectReaderTests-473127572 None] Created volume successfully. Sep 28 15:18:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-ad39e6ba-9996-4142-9b74-563a6fa0fce8-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Lock "cinder-ad39e6ba-9996-4142-9b74-563a6fa0fce8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-quobyte-ad39e6ba-9996-4142-9b74-563a6fa0fce8" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-ad39e6ba-9996-4142-9b74-563a6fa0fce8" acquired by "delete_volume" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c11b3-72a6-423f-8bef-ba9b066c9678]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:08 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 Sep 28 15:18:08 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:08 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8" returned: 0 in 0.605s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:08 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8 Sep 28 15:18:08 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ad39e6ba-9996-4142-9b74-563a6fa0fce8" returned: 0 in 0.380s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-ad39e6ba-9996-4142-9b74-563a6fa0fce8" released by "delete_volume" :: held 1.096s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Created reservations ['18edc56e-7887-4977-98aa-825d17df43d2', 'e8303455-dd1e-4c3f-8373-50329451e673', '92de0b1a-9acb-4ff3-ba12-eb7325b13bf7', '245e3472-5ad4-44f8-929c-5bc1d6c67c04'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:09 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:18:09 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:09 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.472s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Deleted volume successfully. Sep 28 15:18:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3901a761-5a44-41bd-96c2-048b659dcfde tempest-ProjectReaderTests-473127572 None] Lock "cinder-ad39e6ba-9996-4142-9b74-563a6fa0fce8-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (a12968e2-553c-4781-b108-5e3b9ee37e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1a777d-39b5-41e7-beec-94693ccea944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b1a777d-39b5-41e7-beec-94693ccea944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012823932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ee57af-ebb6-42ff-824d-671bfa7b4654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87fb7a9-8421-4736-baaa-ef596c9c3468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87fb7a9-8421-4736-baaa-ef596c9c3468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c39f658-ac3f-4ebb-a489-0d7f23ddefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c39f658-ac3f-4ebb-a489-0d7f23ddefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ee57af-ebb6-42ff-824d-671bfa7b4654', 'volume_name': 'volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b9f5d3-3f0a-4350-9505-5c1622b6f18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b9f5d3-3f0a-4350-9505-5c1622b6f18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84537471-6d8d-4cc4-b719-5c48ce50fd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:11 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Volume a3ee57af-ebb6-42ff-824d-671bfa7b4654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654', 'volume_size': 1} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012823932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ee57af-ebb6-42ff-824d-671bfa7b4654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:11Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Creating volume a3ee57af-ebb6-42ff-824d-671bfa7b4654 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:11 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:11 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 1073741824 Sep 28 15:18:11 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:11 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 1073741824" returned: 0 in 0.587s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:11 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 Sep 28 15:18:11 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:12 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654" returned: 0 in 0.421s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84537471-6d8d-4cc4-b719-5c48ce50fd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf69b94-a1b6-4bda-98a9-f90926556f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:12 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Volume volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 (a3ee57af-ebb6-42ff-824d-671bfa7b4654): created successfully Sep 28 15:18:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf69b94-a1b6-4bda-98a9-f90926556f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (a12968e2-553c-4781-b108-5e3b9ee37e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:12 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f10888f3-437d-4081-b041-2ef21d2893a9 tempest-ProjectReaderTests-473127572 None] Created volume successfully. Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-a3ee57af-ebb6-42ff-824d-671bfa7b4654-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Lock "cinder-a3ee57af-ebb6-42ff-824d-671bfa7b4654-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-quobyte-a3ee57af-ebb6-42ff-824d-671bfa7b4654" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-a3ee57af-ebb6-42ff-824d-671bfa7b4654" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f363b74e-7792-4062-a27c-51ccb99361ed]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 Sep 28 15:18:13 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:13 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654" returned: 0 in 0.472s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:13 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654 Sep 28 15:18:13 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3ee57af-ebb6-42ff-824d-671bfa7b4654" returned: 0 in 0.335s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-a3ee57af-ebb6-42ff-824d-671bfa7b4654" released by "delete_volume" :: held 0.874s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Created reservations ['5844ae3d-5eec-430b-9a9a-c3ea08a16c33', '06150965-a19d-41e3-9f8e-d70f0c795737', '2120eb37-c410-4bee-abc0-f87c474c4b52', '5cd5e75c-d752-4839-a283-d27253b5b750'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:14 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:18:14 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:14 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.359s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Deleted volume successfully. Sep 28 15:18:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-42130684-fe5a-4ae8-b424-8d4dba9a2652 tempest-ProjectReaderTests-473127572 None] Lock "cinder-a3ee57af-ebb6-42ff-824d-671bfa7b4654-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (f5604fca-aa10-457c-ac09-c46e5d41e0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702d97c4-1f9c-49a1-9f01-267d5226f42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702d97c4-1f9c-49a1-9f01-267d5226f42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1357038539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32eeb889-5ffd-4fcb-b661-653c355b630d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:15Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03c00e7-e519-4dd3-8a83-fc3ec13c3fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03c00e7-e519-4dd3-8a83-fc3ec13c3fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d50dedf-3ccf-40ff-8920-0be4901cc96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d50dedf-3ccf-40ff-8920-0be4901cc96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32eeb889-5ffd-4fcb-b661-653c355b630d', 'volume_name': 'volume-32eeb889-5ffd-4fcb-b661-653c355b630d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b323ad21-7bb1-4d70-90a6-1a94bc99af2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b323ad21-7bb1-4d70-90a6-1a94bc99af2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aced6db-f5ae-4b7c-9936-b3da35cf7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:15 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Volume 32eeb889-5ffd-4fcb-b661-653c355b630d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32eeb889-5ffd-4fcb-b661-653c355b630d', 'volume_size': 1} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1357038539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32eeb889-5ffd-4fcb-b661-653c355b630d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:15Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Creating volume 32eeb889-5ffd-4fcb-b661-653c355b630d {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:15 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:15 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d 1073741824 Sep 28 15:18:15 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:15 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d 1073741824" returned: 0 in 0.671s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:15 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d Sep 28 15:18:15 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:16 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d" returned: 0 in 0.367s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aced6db-f5ae-4b7c-9936-b3da35cf7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32eeb889-5ffd-4fcb-b661-653c355b630d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc1c602-999e-4e77-b733-f81d47a6cc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:16 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Volume volume-32eeb889-5ffd-4fcb-b661-653c355b630d (32eeb889-5ffd-4fcb-b661-653c355b630d): created successfully Sep 28 15:18:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc1c602-999e-4e77-b733-f81d47a6cc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (f5604fca-aa10-457c-ac09-c46e5d41e0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8dda53e8-c5c5-4472-8831-b658f92f4648 tempest-ProjectReaderTests-473127572 None] Created volume successfully. Sep 28 15:18:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-32eeb889-5ffd-4fcb-b661-653c355b630d-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Lock "cinder-32eeb889-5ffd-4fcb-b661-653c355b630d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-quobyte-32eeb889-5ffd-4fcb-b661-653c355b630d" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-32eeb889-5ffd-4fcb-b661-653c355b630d" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[727b8dd3-bc1e-40fa-a124-93be431590c1]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:17 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d Sep 28 15:18:17 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:18 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d" returned: 0 in 0.549s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:18 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d Sep 28 15:18:18 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:18 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-32eeb889-5ffd-4fcb-b661-653c355b630d" returned: 0 in 0.371s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-32eeb889-5ffd-4fcb-b661-653c355b630d" released by "delete_volume" :: held 1.010s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Created reservations ['f7952296-d41d-4a3e-99a8-af20a73c5e33', 'c9372d3c-d9c3-4c71-8d11-940242bd7269', '58ec0cb8-718b-4767-9cb8-f7f6ab891dcd', '61575903-3b39-4210-86e2-c95a1a724ca9'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:18 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:18:18 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:19 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.409s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:19 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Deleted volume successfully. Sep 28 15:18:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5fbb2e2c-64cb-4fb3-aae0-b707fe0244df tempest-ProjectReaderTests-473127572 None] Lock "cinder-32eeb889-5ffd-4fcb-b661-653c355b630d-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (c3319af9-d2b5-49c0-aa0c-dac30a74e079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e39ad-f1a3-4a9a-8f75-d960fbac432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e39ad-f1a3-4a9a-8f75-d960fbac432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-239558646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:20Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ff5b15-6325-44c6-8352-b630b72306f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ff5b15-6325-44c6-8352-b630b72306f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e44aa4f-b135-4053-ab1a-702e71bb683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e44aa4f-b135-4053-ab1a-702e71bb683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7', 'volume_name': 'volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25b973c-cec2-43c6-a888-6b723fdfaeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25b973c-cec2-43c6-a888-6b723fdfaeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb39504-e93c-4c1b-b0e8-4daac54ac91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:20 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Volume 5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7', 'volume_size': 1} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-239558646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='056436d183184bbc871d2f7c18589fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:18:20Z,use_quota=True,user_id='12e3df3bbe1b4fce822fe7cf2d94f691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Creating volume 5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:18:20 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:18:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:20 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 1073741824 Sep 28 15:18:20 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:21 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 1073741824" returned: 0 in 0.694s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:21 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 Sep 28 15:18:21 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:21 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7" returned: 0 in 0.367s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb39504-e93c-4c1b-b0e8-4daac54ac91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af47a73-e76b-4344-a78a-6588f8c6d83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:18:21 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Volume volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 (5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7): created successfully Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af47a73-e76b-4344-a78a-6588f8c6d83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:18:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Flow 'volume_create_manager' (c3319af9-d2b5-49c0-aa0c-dac30a74e079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:18:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ff525d84-2934-4d79-81c4-a6e112093381 tempest-ProjectReaderTests-473127572 None] Created volume successfully. Sep 28 15:18:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Lock "cinder-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Acquiring lock "cinder-quobyte-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:22 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8788d7-a9b7-423a-bef9-81b835ebe476]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:22 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 Sep 28 15:18:22 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:23 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7" returned: 0 in 0.544s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:23 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7 Sep 28 15:18:23 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:23 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7" returned: 0 in 0.321s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Lock "cinder-quobyte-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7" released by "delete_volume" :: held 0.929s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Created reservations ['7626357f-022a-450d-9ffc-f6ec445121f1', 'a9a7665b-38d8-4913-a562-cfc18cc31759', 'e3c8b85a-723a-4b59-8ee8-2cf99736001c', 'f67d2210-0ce9-496e-96ea-ba0f77d677af'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:23 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:18:23 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:24 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.369s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:24 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Deleted volume successfully. Sep 28 15:18:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87687eff-9504-4821-9f3e-fb665226e692 tempest-ProjectReaderTests-473127572 None] Lock "cinder-5e2ea051-9fd2-4a17-beea-a0ecc2bdc0a7-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-1ec4960b-3210-4bad-b009-5ce9b0b12b0c tempest-TestShelveInstance-996076117 None] Terminate volume connection completed successfully. Sep 28 15:18:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-1ec4960b-3210-4bad-b009-5ce9b0b12b0c tempest-TestShelveInstance-996076117 None] Deleting attachment a9eb6c0d-7b93-4986-b9b8-73914da5a7fe. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:18:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Acquiring lock "cinder-00968453-4763-40bf-8718-e37f5cb32bcb-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Lock "cinder-00968453-4763-40bf-8718-e37f5cb32bcb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Acquiring lock "cinder-quobyte-00968453-4763-40bf-8718-e37f5cb32bcb" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:18:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Lock "cinder-quobyte-00968453-4763-40bf-8718-e37f5cb32bcb" acquired by "delete_volume" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:18:33 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee9d9a3-5908-4fc6-b5c1-84db8c7a22a8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:18:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:33 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb Sep 28 15:18:33 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:34 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb" returned: 0 in 1.039s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:34 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb Sep 28 15:18:34 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:35 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00968453-4763-40bf-8718-e37f5cb32bcb" returned: 0 in 0.501s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Lock "cinder-quobyte-00968453-4763-40bf-8718-e37f5cb32bcb" released by "delete_volume" :: held 1.639s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG cinder.quota [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Created reservations ['8a40205f-3c17-4999-81ee-2f94f778ec99', 'e32cc601-dcee-486e-99fe-238e17a577d9', '0817e8fc-cebd-478f-bd5d-df069e535103', '9c0613dd-f3dc-40df-a11f-d092990a2725'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:35 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:18:35 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:35 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.336s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG cinder.manager [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Deleted volume successfully. Sep 28 15:18:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [req-e9fbe81e-c76a-43be-9ad3-2477cf9e72b5 req-68469672-8102-40a3-99c3-904c4fe762a2 tempest-TestShelveInstance-996076117 None] Lock "cinder-00968453-4763-40bf-8718-e37f5cb32bcb-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:18:47 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:18:47 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:18:47 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.345s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:18:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:18:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=51,cinder:SELECT=34,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:18:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=35,cinder:UPDATE=54,cinder:INSERT=14,cinder:DELETE=7 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Flow 'volume_create_manager' (e5cba259-52e1-4110-994a-d3c861b017a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c024b4a-9f5c-4b58-95ed-10aa03a2082a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c024b4a-9f5c-4b58-95ed-10aa03a2082a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-250538623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da683ca-66f3-45af-a29b-e80e5ce73fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6da26bf5b5948aa808496668e774401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:00Z,use_quota=True,user_id='ae3a50bb5cd04be0bea2ada5bdef68bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964a8d46-6da9-4773-8979-ebbec4f64814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964a8d46-6da9-4773-8979-ebbec4f64814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a497a23-5227-45a8-ac42-9b4677f3df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a497a23-5227-45a8-ac42-9b4677f3df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da683ca-66f3-45af-a29b-e80e5ce73fa2', 'volume_name': 'volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa4742c-6c5e-4b5d-b824-e25e37c58a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa4742c-6c5e-4b5d-b824-e25e37c58a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb2dc79-261b-44a1-8438-2be3fb02ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Volume 1da683ca-66f3-45af-a29b-e80e5ce73fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2', 'volume_size': 1} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-250538623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da683ca-66f3-45af-a29b-e80e5ce73fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6da26bf5b5948aa808496668e774401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:00Z,use_quota=True,user_id='ae3a50bb5cd04be0bea2ada5bdef68bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Creating volume 1da683ca-66f3-45af-a29b-e80e5ce73fa2 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:00 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:19:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:00 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 1073741824 Sep 28 15:19:00 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 1073741824" returned: 0 in 0.644s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:01 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 Sep 28 15:19:01 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:01 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2" returned: 0 in 0.302s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb2dc79-261b-44a1-8438-2be3fb02ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9dc3d3-c42d-43f7-b4b5-2ee408fad726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:01 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Volume volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 (1da683ca-66f3-45af-a29b-e80e5ce73fa2): created successfully Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9dc3d3-c42d-43f7-b4b5-2ee408fad726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Flow 'volume_create_manager' (e5cba259-52e1-4110-994a-d3c861b017a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:01 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-eb106f71-87f2-432e-8236-dc309ca6c555 tempest-AttachVolumeNegativeTest-708884335 None] Created volume successfully. Sep 28 15:19:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-fed31c32-dfd8-4436-8b24-27dc26b0f6ab req-8cfe9e0d-b712-449c-96ee-ddd22ce52821 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-fed31c32-dfd8-4436-8b24-27dc26b0f6ab req-8cfe9e0d-b712-449c-96ee-ddd22ce52821 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-fed31c32-dfd8-4436-8b24-27dc26b0f6ab req-8cfe9e0d-b712-449c-96ee-ddd22ce52821 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-fed31c32-dfd8-4436-8b24-27dc26b0f6ab req-8cfe9e0d-b712-449c-96ee-ddd22ce52821 tempest-AttachVolumeNegativeTest-708884335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75d9fd7a-8de3-4661-a7aa-b791d7fa8881', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:19:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-fed31c32-dfd8-4436-8b24-27dc26b0f6ab req-8cfe9e0d-b712-449c-96ee-ddd22ce52821 tempest-AttachVolumeNegativeTest-708884335 None] attachment_update completed successfully. Sep 28 15:19:13 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:13 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=3,cinder:SELECT=11 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Flow 'volume_create_manager' (a447f270-bcfa-4175-a7d4-4dc3066644d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa1d567-8b49-465d-a3c1-e4ec6b790386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa1d567-8b49-465d-a3c1-e4ec6b790386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2145912458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224eb276-022c-46a0-b994-9275b5644723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357ccc4f12a448c4be8903ff743975a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:25Z,use_quota=True,user_id='da4f96d328f64f4190674d1b868ac9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d1d57-7786-4b2d-94e2-d058f9132edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d1d57-7786-4b2d-94e2-d058f9132edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b4a3a6-0ad8-47c6-841f-b1e089b734fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b4a3a6-0ad8-47c6-841f-b1e089b734fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224eb276-022c-46a0-b994-9275b5644723', 'volume_name': 'volume-224eb276-022c-46a0-b994-9275b5644723', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e366e2-c5f5-478a-a5dc-eccfb86d648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e366e2-c5f5-478a-a5dc-eccfb86d648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698c8416-80ac-4493-a8b4-3413db2e992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Volume 224eb276-022c-46a0-b994-9275b5644723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224eb276-022c-46a0-b994-9275b5644723', 'volume_size': 1} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2145912458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224eb276-022c-46a0-b994-9275b5644723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357ccc4f12a448c4be8903ff743975a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:19:25Z,use_quota=True,user_id='da4f96d328f64f4190674d1b868ac9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Creating volume 224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:19:24 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:19:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:24 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 1073741824 Sep 28 15:19:24 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:25 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 1073741824" returned: 0 in 0.807s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:25 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 Sep 28 15:19:25 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:26 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723" returned: 0 in 0.413s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:19:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698c8416-80ac-4493-a8b4-3413db2e992e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224eb276-022c-46a0-b994-9275b5644723', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4fed41-d013-47c1-bd06-19a0bef44f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:19:26 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Volume volume-224eb276-022c-46a0-b994-9275b5644723 (224eb276-022c-46a0-b994-9275b5644723): created successfully Sep 28 15:19:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4fed41-d013-47c1-bd06-19a0bef44f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:19:26 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Flow 'volume_create_manager' (a447f270-bcfa-4175-a7d4-4dc3066644d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:19:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-97818df1-119e-4356-a50c-0c91fb20b80b tempest-TestStampPattern-884335675 None] Created volume successfully. Sep 28 15:19:36 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:36 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:19:47 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:19:47 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:19:47 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.308s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:19:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:19:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-8600b1d6-395a-4e44-b2a2-0fc6e8109fa4 req-198b15a9-a7b9-4a07-9c9c-15ea079e00e6 tempest-AttachVolumeNegativeTest-708884335 None] Terminate volume connection completed successfully. Sep 28 15:19:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-8600b1d6-395a-4e44-b2a2-0fc6e8109fa4 req-198b15a9-a7b9-4a07-9c9c-15ea079e00e6 tempest-AttachVolumeNegativeTest-708884335 None] Deleting attachment 75d9fd7a-8de3-4661-a7aa-b791d7fa8881. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:19:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e9e3deca-7199-43b8-b777-a86c5cd2f600 req-e2c8f4e5-5861-4fae-85b7-05123854c2ad tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:19:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e9e3deca-7199-43b8-b777-a86c5cd2f600 req-e2c8f4e5-5861-4fae-85b7-05123854c2ad tempest-TestStampPattern-884335675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:19:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-e9e3deca-7199-43b8-b777-a86c5cd2f600 req-e2c8f4e5-5861-4fae-85b7-05123854c2ad tempest-TestStampPattern-884335675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:19:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-e9e3deca-7199-43b8-b777-a86c5cd2f600 req-e2c8f4e5-5861-4fae-85b7-05123854c2ad tempest-TestStampPattern-884335675 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-224eb276-022c-46a0-b994-9275b5644723', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb84f750-a9ff-4749-bfaf-1612689f6ee6', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:19:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-e9e3deca-7199-43b8-b777-a86c5cd2f600 req-e2c8f4e5-5861-4fae-85b7-05123854c2ad tempest-TestStampPattern-884335675 None] attachment_update completed successfully. Sep 28 15:20:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-c6a386a2-d30c-4512-b4e8-bcb4608d72f9 req-ac92d1b0-ddf3-4f84-bce2-81db1426f138 tempest-TestStampPattern-884335675 None] Terminate volume connection completed successfully. Sep 28 15:20:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-c6a386a2-d30c-4512-b4e8-bcb4608d72f9 req-ac92d1b0-ddf3-4f84-bce2-81db1426f138 tempest-TestStampPattern-884335675 None] Deleting attachment fb84f750-a9ff-4749-bfaf-1612689f6ee6. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:20:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Creating offline snapshot 4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 of volume 224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:20:07 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e64f47-e03c-47e1-9aea-c25013e521a3]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:07 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 Sep 28 15:20:07 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:07 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723" returned: 0 in 0.601s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:07 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 1G Sep 28 15:20:07 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:08 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 1G" returned: 0 in 0.682s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224eb276-022c-46a0-b994-9275b5644723 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:08 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224eb276-022c-46a0-b994-9275b5644723 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 Sep 28 15:20:08 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:08 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-224eb276-022c-46a0-b994-9275b5644723 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" returned: 0 in 0.448s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:08 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 is being set with open permissions: ugo+rw Sep 28 15:20:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:08 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 Sep 28 15:20:08 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:09 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" returned: 0 in 0.361s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:09 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.info Sep 28 15:20:09 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:09 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.info" returned: 0 in 0.330s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:09 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.info is being set with open permissions: ugo+rw Sep 28 15:20:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:09 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.info Sep 28 15:20:09 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:09 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.info" returned: 0 in 0.296s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.860s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2772900f-f343-4575-8818-e2b32a115daa tempest-TestStampPattern-884335675 None] Create snapshot completed successfully Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Flow 'volume_create_manager' (b132b071-10ea-44c5-982b-8e95a9f0938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82cd3f6-5f1b-4ac2-93c3-3194df5e4158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82cd3f6-5f1b-4ac2-93c3-3194df5e4158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1322045273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357ccc4f12a448c4be8903ff743975a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:17Z,use_quota=True,user_id='da4f96d328f64f4190674d1b868ac9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7193b4-18d9-4b85-894a-8f11c8748d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7193b4-18d9-4b85-894a-8f11c8748d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1132e274-6484-400e-a1cf-a179d2f88999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1132e274-6484-400e-a1cf-a179d2f88999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9', 'volume_name': 'volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9', 'volume_size': 1, 'snapshot_id': '4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2519e182-1a91-4317-9f1a-1bbbbf6eb6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2519e182-1a91-4317-9f1a-1bbbbf6eb6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f7f9cc-f6db-4e01-a2a2-763b036cbc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:17 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Volume 06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9', 'volume_size': 1, 'snapshot_id': '4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384'} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-quobyte-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Creating volume 06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 from snapshot 4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-quobyte-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] snapshot: 4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384, volume: 06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5296cf16-048a-4ba6-9241-a500f82f64b5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:17 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 Sep 28 15:20:17 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:18 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" returned: 0 in 0.412s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224eb276-022c-46a0-b994-9275b5644723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eaac65-d626-4cbf-9325-99ee3c4a82c4]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:18 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 Sep 28 15:20:18 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:18 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723" returned: 0 in 0.493s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:20:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:18 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 Sep 28 15:20:18 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:29 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" returned: 0 in 10.463s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723, size 1024.00 MB, duration 10.46 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:20:29 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Converted 1024.00 MB image at 97.86 MB/s Sep 28 15:20:29 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 is being set with open permissions: ugo+rw Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:29 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 Sep 28 15:20:29 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:29 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" returned: 0 in 0.560s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" released by "_copy_volume_from_snapshot" :: held 12.035s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" released by "_create_volume_from_snapshot" :: held 12.149s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.169s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f7f9cc-f6db-4e01-a2a2-763b036cbc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9', 'volume_size': 1, 'snapshot_id': '4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d205b2-c242-4b6f-a01b-65c3a63633db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Volume volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 (06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9): created successfully Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d205b2-c242-4b6f-a01b-65c3a63633db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Flow 'volume_create_manager' (b132b071-10ea-44c5-982b-8e95a9f0938c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a50f6992-9755-4647-851a-ca853076228d tempest-TestStampPattern-884335675 None] Created volume successfully. Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Flow 'volume_create_manager' (2f99eea2-08fb-47c7-90ff-199be9774d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3d4860-6f07-4d60-8a39-a221323c7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3d4860-6f07-4d60-8a39-a221323c7760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1876890492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a02dc-f30d-4d43-b6f0-fdc556adccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6da26bf5b5948aa808496668e774401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:30Z,use_quota=True,user_id='ae3a50bb5cd04be0bea2ada5bdef68bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb29a751-c17e-49c0-b122-2402257ce902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb29a751-c17e-49c0-b122-2402257ce902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cc1349-1844-43eb-9155-b81794a4ec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cc1349-1844-43eb-9155-b81794a4ec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17a02dc-f30d-4d43-b6f0-fdc556adccb8', 'volume_name': 'volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b7a618-f2c3-45dd-9251-4b9f0e38b931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b7a618-f2c3-45dd-9251-4b9f0e38b931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acec1b1c-417d-4a93-9b54-d84de88e7195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Volume e17a02dc-f30d-4d43-b6f0-fdc556adccb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8', 'volume_size': 1} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1876890492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a02dc-f30d-4d43-b6f0-fdc556adccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6da26bf5b5948aa808496668e774401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:20:30Z,use_quota=True,user_id='ae3a50bb5cd04be0bea2ada5bdef68bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Creating volume e17a02dc-f30d-4d43-b6f0-fdc556adccb8 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:20:30 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:20:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:30 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 1073741824 Sep 28 15:20:30 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:31 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 1073741824" returned: 0 in 0.622s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:31 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 Sep 28 15:20:31 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:31 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8" returned: 0 in 0.381s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acec1b1c-417d-4a93-9b54-d84de88e7195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee517c-4857-4a2c-a320-54ce0f240da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:20:31 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Volume volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 (e17a02dc-f30d-4d43-b6f0-fdc556adccb8): created successfully Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee517c-4857-4a2c-a320-54ce0f240da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:20:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Flow 'volume_create_manager' (2f99eea2-08fb-47c7-90ff-199be9774d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:20:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fd1a14cd-60c6-4caa-976a-fc88dbf067da tempest-AttachVolumeNegativeTest-708884335 None] Created volume successfully. Sep 28 15:20:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-1f51bcbe-9b4d-4b8e-920f-1619aab6bd43 req-23dd4dab-09cb-4cf1-8bec-4f809758ecff tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-1f51bcbe-9b4d-4b8e-920f-1619aab6bd43 req-23dd4dab-09cb-4cf1-8bec-4f809758ecff tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-1f51bcbe-9b4d-4b8e-920f-1619aab6bd43 req-23dd4dab-09cb-4cf1-8bec-4f809758ecff tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-1f51bcbe-9b4d-4b8e-920f-1619aab6bd43 req-23dd4dab-09cb-4cf1-8bec-4f809758ecff tempest-AttachVolumeNegativeTest-708884335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0160bb3-f70d-4379-a488-f3dc0cef4054', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:20:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-1f51bcbe-9b4d-4b8e-920f-1619aab6bd43 req-23dd4dab-09cb-4cf1-8bec-4f809758ecff tempest-AttachVolumeNegativeTest-708884335 None] attachment_update completed successfully. Sep 28 15:20:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-ce7210fd-723c-4bd8-9665-483188b5e3b1 req-71ece7c0-15f1-4359-b270-ff9239117a99 tempest-AttachVolumeNegativeTest-708884335 None] Terminate volume connection completed successfully. Sep 28 15:20:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-ce7210fd-723c-4bd8-9665-483188b5e3b1 req-71ece7c0-15f1-4359-b270-ff9239117a99 tempest-AttachVolumeNegativeTest-708884335 None] Deleting attachment c0160bb3-f70d-4379-a488-f3dc0cef4054. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:20:46 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:20:47 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:20:47 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:20:47 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.380s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:20:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:20:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=8,cinder:INSERT=2,cinder:SELECT=11,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:21:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d37a99a9-75cd-45cf-bac5-50fe6ea5160c req-9b434b13-81d2-4d67-8c32-fbd2c93645c9 tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d37a99a9-75cd-45cf-bac5-50fe6ea5160c req-9b434b13-81d2-4d67-8c32-fbd2c93645c9 tempest-TestStampPattern-884335675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-d37a99a9-75cd-45cf-bac5-50fe6ea5160c req-9b434b13-81d2-4d67-8c32-fbd2c93645c9 tempest-TestStampPattern-884335675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-d37a99a9-75cd-45cf-bac5-50fe6ea5160c req-9b434b13-81d2-4d67-8c32-fbd2c93645c9 tempest-TestStampPattern-884335675 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41a9f8db-7447-49a1-b91b-f3865ebcd55d', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:21:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-d37a99a9-75cd-45cf-bac5-50fe6ea5160c req-9b434b13-81d2-4d67-8c32-fbd2c93645c9 tempest-TestStampPattern-884335675 None] attachment_update completed successfully. Sep 28 15:21:15 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-92159898-ca00-4e28-b8eb-f9bfa0414c94 req-4a445f8a-c881-42e3-8b37-fb7e2dcb2b7c tempest-TestStampPattern-884335675 None] Terminate volume connection completed successfully. Sep 28 15:21:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-92159898-ca00-4e28-b8eb-f9bfa0414c94 req-4a445f8a-c881-42e3-8b37-fb7e2dcb2b7c tempest-TestStampPattern-884335675 None] Deleting attachment 41a9f8db-7447-49a1-b91b-f3865ebcd55d. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Lock "cinder-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-quobyte-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[35089d21-3e0f-4cf6-b0c4-40113fb21e09]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:20 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 Sep 28 15:21:20 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:20 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" returned: 0 in 0.389s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:20 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9 Sep 28 15:21:20 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:20 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9" released by "delete_volume" :: held 0.721s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Created reservations ['6a520dbb-c986-470c-9f61-0937cf557a6d', 'eece610b-ad2f-4f59-b2df-8a155996d365', 'a974038b-306d-4760-97a4-f20d5550a4af', 'dab81088-1f28-40d8-b7f9-d9c453579f81'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:21 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.309s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Deleted volume successfully. Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-617395ed-d138-4820-bf0b-5194313a067f tempest-TestStampPattern-884335675 None] Lock "cinder-06a7e9b3-3b4c-40b6-98f8-bcef21d7a6a9-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Flow 'volume_create_manager' (911eee8f-319b-4234-b149-63f94e19437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c28781-a96a-4b7f-95d9-f177d3112d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c28781-a96a-4b7f-95d9-f177d3112d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1033788985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a9e502-516a-4186-970f-01e4eb19bdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6da26bf5b5948aa808496668e774401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:22Z,use_quota=True,user_id='ae3a50bb5cd04be0bea2ada5bdef68bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532d1525-d780-4a1a-ae5a-84bd939509e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532d1525-d780-4a1a-ae5a-84bd939509e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f61fdb0-9741-42a6-b4fb-a8366e33bd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f61fdb0-9741-42a6-b4fb-a8366e33bd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a9e502-516a-4186-970f-01e4eb19bdc4', 'volume_name': 'volume-e5a9e502-516a-4186-970f-01e4eb19bdc4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8aa60e-c373-4748-9b13-fdb5ef6efff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8aa60e-c373-4748-9b13-fdb5ef6efff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe82298-f13a-4619-9fe2-908d4c170e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:21 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Volume e5a9e502-516a-4186-970f-01e4eb19bdc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a9e502-516a-4186-970f-01e4eb19bdc4', 'volume_size': 1} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1033788985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a9e502-516a-4186-970f-01e4eb19bdc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6da26bf5b5948aa808496668e774401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:22Z,use_quota=True,user_id='ae3a50bb5cd04be0bea2ada5bdef68bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Creating volume e5a9e502-516a-4186-970f-01e4eb19bdc4 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:21 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:21 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 1073741824 Sep 28 15:21:21 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Lock "cinder-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-quobyte-224eb276-022c-46a0-b994-9275b5644723" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-224eb276-022c-46a0-b994-9275b5644723" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-quobyte-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Deleting offline snapshot 4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 of volume 224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] snapshot_file for this snap is: volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa38d51-51fd-45b3-a22a-bebfbbc38c17]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:21 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 Sep 28 15:21:21 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 1073741824" returned: 0 in 0.502s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" returned: 0 in 0.431s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-224eb276-022c-46a0-b994-9275b5644723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e17500e-c95c-46d3-9132-07ecaf4d87ab]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 Sep 28 15:21:22 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 Sep 28 15:21:22 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:22 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4" returned: 0 in 0.270s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe82298-f13a-4619-9fe2-908d4c170e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a9e502-516a-4186-970f-01e4eb19bdc4', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfca56c-9efa-4cda-a076-1e25c66252db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:22 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Volume volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 (e5a9e502-516a-4186-970f-01e4eb19bdc4): created successfully Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dfca56c-9efa-4cda-a076-1e25c66252db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Flow 'volume_create_manager' (911eee8f-319b-4234-b149-63f94e19437e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a6765f44-504a-47df-8c25-36f71af7ebb9 tempest-AttachVolumeNegativeTest-708884335 None] Created volume successfully. Sep 28 15:21:22 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723" returned: 0 in 0.598s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:22 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 Sep 28 15:21:22 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" returned: 0 in 0.377s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:23 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384 Sep 28 15:21:23 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:23 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723.4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" returned: 0 in 0.308s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384" released by "_delete_snapshot" :: held 1.855s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-224eb276-022c-46a0-b994-9275b5644723" released by "delete_snapshot" :: held 1.877s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:23 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Created reservations ['ad647610-bc16-4a68-aaf9-bd12994e357c', 'c70f7614-2b92-428c-a6d5-8d36993c4320', 'ddb543a0-d293-41e0-bdc7-b66a05122595', 'e6ace109-292c-482e-b61f-ba5416c0472a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:23 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Delete snapshot completed successfully. Sep 28 15:21:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-80757d6c-860c-4f61-9a73-ff24881d053c tempest-TestStampPattern-884335675 None] Lock "cinder-4043fc87-d7b4-4cd7-a1e8-7b4a62f8a384-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-fffa5223-510d-4633-8fb5-173d1e8819f0 req-5414887a-eaab-4c9a-8a9c-ea570f6ed2dd tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-fffa5223-510d-4633-8fb5-173d1e8819f0 req-5414887a-eaab-4c9a-8a9c-ea570f6ed2dd tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [req-fffa5223-510d-4633-8fb5-173d1e8819f0 req-5414887a-eaab-4c9a-8a9c-ea570f6ed2dd tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-fffa5223-510d-4633-8fb5-173d1e8819f0 req-5414887a-eaab-4c9a-8a9c-ea570f6ed2dd tempest-AttachVolumeNegativeTest-708884335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428', 'name': 'volume-e5a9e502-516a-4186-970f-01e4eb19bdc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20a89bab-f8e7-462d-9787-7d9c4b021ef4', 'enforce_multipath': True} {{(pid=86301) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 15:21:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-fffa5223-510d-4633-8fb5-173d1e8819f0 req-5414887a-eaab-4c9a-8a9c-ea570f6ed2dd tempest-AttachVolumeNegativeTest-708884335 None] attachment_update completed successfully. Sep 28 15:21:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [req-69f96602-0092-4810-bafd-d327cba13639 req-bf21abca-d173-4848-8540-d0f0c7d0a0df tempest-AttachVolumeNegativeTest-708884335 None] Terminate volume connection completed successfully. Sep 28 15:21:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [req-69f96602-0092-4810-bafd-d327cba13639 req-bf21abca-d173-4848-8540-d0f0c7d0a0df tempest-AttachVolumeNegativeTest-708884335 None] Deleting attachment 20a89bab-f8e7-462d-9787-7d9c4b021ef4. {{(pid=86301) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 15:21:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-224eb276-022c-46a0-b994-9275b5644723-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Lock "cinder-224eb276-022c-46a0-b994-9275b5644723-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Acquiring lock "cinder-quobyte-224eb276-022c-46a0-b994-9275b5644723" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-224eb276-022c-46a0-b994-9275b5644723" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ced65b-53d0-4afe-a149-027cf2a747ad]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:29 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 Sep 28 15:21:29 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723" returned: 0 in 0.477s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:30 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723 Sep 28 15:21:30 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:30 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-224eb276-022c-46a0-b994-9275b5644723" returned: 0 in 0.337s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Lock "cinder-quobyte-224eb276-022c-46a0-b994-9275b5644723" released by "delete_volume" :: held 0.966s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Created reservations ['0dc4f41a-445d-4d65-b80c-b5b5fb334436', 'e0930b65-379b-4eab-a07c-55a8a61f5071', '47629c62-0740-42a3-8d81-af8073dd9ad8', 'c05a8667-b6a1-4303-a76b-1cd25c595e17'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:30 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:30 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:31 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.350s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:31 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Deleted volume successfully. Sep 28 15:21:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7939982a-2d3d-4d8e-82be-7883f98a71a5 tempest-TestStampPattern-884335675 None] Lock "cinder-224eb276-022c-46a0-b994-9275b5644723-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "cinder-e5a9e502-516a-4186-970f-01e4eb19bdc4-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-e5a9e502-516a-4186-970f-01e4eb19bdc4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "cinder-quobyte-e5a9e502-516a-4186-970f-01e4eb19bdc4" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-quobyte-e5a9e502-516a-4186-970f-01e4eb19bdc4" acquired by "delete_volume" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bbd49a-59e3-4d8e-bc06-74dc4b091705]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:34 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 Sep 28 15:21:34 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:34 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4" returned: 0 in 0.525s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:34 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4 Sep 28 15:21:34 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:34 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e5a9e502-516a-4186-970f-01e4eb19bdc4" returned: 0 in 0.334s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-quobyte-e5a9e502-516a-4186-970f-01e4eb19bdc4" released by "delete_volume" :: held 0.927s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Created reservations ['97877530-d487-4723-967d-d4655723fd7b', '97bb3258-53e5-42c8-84e6-037dfd25f205', 'c1a65472-83e8-4047-878b-977639923db9', '2fbc2659-94c4-4477-bf43-b3f5a9caa7b5'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:35 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:35 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:35 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.311s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Deleted volume successfully. Sep 28 15:21:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2378523e-1e2a-40a2-997c-db0e820ef6f9 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-e5a9e502-516a-4186-970f-01e4eb19bdc4-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "cinder-e17a02dc-f30d-4d43-b6f0-fdc556adccb8-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-e17a02dc-f30d-4d43-b6f0-fdc556adccb8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "cinder-quobyte-e17a02dc-f30d-4d43-b6f0-fdc556adccb8" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-quobyte-e17a02dc-f30d-4d43-b6f0-fdc556adccb8" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc32207a-6410-4e68-a051-3218a02cc1a9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:36 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 Sep 28 15:21:36 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:36 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8" returned: 0 in 0.470s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:37 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8 Sep 28 15:21:37 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:37 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e17a02dc-f30d-4d43-b6f0-fdc556adccb8" returned: 0 in 0.372s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-quobyte-e17a02dc-f30d-4d43-b6f0-fdc556adccb8" released by "delete_volume" :: held 0.905s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Created reservations ['e53178da-d890-4bfd-934f-ecf98b081719', '1859f96a-2bc0-4315-832a-5ed4bc2816c5', '8b2f8c0c-e3f2-458f-9863-6ce5c4dd072e', '03118812-1da8-4539-abda-e70c7645c58d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:37 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:37 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "cinder-1da683ca-66f3-45af-a29b-e80e5ce73fa2-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-1da683ca-66f3-45af-a29b-e80e5ce73fa2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:37 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.340s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Deleted volume successfully. Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "cinder-quobyte-1da683ca-66f3-45af-a29b-e80e5ce73fa2" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1a32f86d-125a-4731-b92c-c5d17c717e65 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-e17a02dc-f30d-4d43-b6f0-fdc556adccb8-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-quobyte-1da683ca-66f3-45af-a29b-e80e5ce73fa2" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fb062a-888a-4696-ac2f-ea2f45a96566]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:38 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 Sep 28 15:21:38 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:38 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2" returned: 0 in 0.482s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:38 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2 Sep 28 15:21:38 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:38 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1da683ca-66f3-45af-a29b-e80e5ce73fa2" returned: 0 in 0.348s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-quobyte-1da683ca-66f3-45af-a29b-e80e5ce73fa2" released by "delete_volume" :: held 0.884s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Created reservations ['2ea8b058-01f9-4e3b-889e-53a53d721b7d', '4acb4b0a-d4bc-48ff-93c7-59c81c697a5a', 'a2a2974a-16b9-44fd-af82-2258a4f619c3', 'df7924d4-b7b7-4469-b6ca-c407972c04b4'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:39 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:39 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:39 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.346s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:39 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Deleted volume successfully. Sep 28 15:21:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7a80dbd3-238e-4e81-8934-955302bbbbd3 tempest-AttachVolumeNegativeTest-708884335 None] Lock "cinder-1da683ca-66f3-45af-a29b-e80e5ce73fa2-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:47 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:47 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:47 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.303s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (7d58dd65-fb5e-4a9c-97ef-d812a923e1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421de8a5-75d6-4618-a181-cb7237355958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421de8a5-75d6-4618-a181-cb7237355958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054218040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907dd8e6-5ec2-483d-9fe2-c0812632f90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b053307-f1ae-420f-8f09-e6d638fe3820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b053307-f1ae-420f-8f09-e6d638fe3820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2c7bd6-1e72-4ecd-9cb4-ad6251192972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2c7bd6-1e72-4ecd-9cb4-ad6251192972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907dd8e6-5ec2-483d-9fe2-c0812632f90d', 'volume_name': 'volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bdf36e-6d5b-483c-a16a-163be48cd90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47bdf36e-6d5b-483c-a16a-163be48cd90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c2c2cc-471f-4051-ac0e-cccb356c0e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:47 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Volume 907dd8e6-5ec2-483d-9fe2-c0812632f90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d', 'volume_size': 1} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054218040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907dd8e6-5ec2-483d-9fe2-c0812632f90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Creating volume 907dd8e6-5ec2-483d-9fe2-c0812632f90d {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:47 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:21:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:47 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d 1073741824 Sep 28 15:21:47 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (848eef33-4f21-4583-b521-b8db273c4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6ea6d8-ce6e-4e3b-b9c9-589239010888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6ea6d8-ce6e-4e3b-b9c9-589239010888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467299258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c013358-11f8-43f5-80b6-dfccc93a119c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f692f5-dee1-4a98-9fc4-a002ad1c951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f692f5-dee1-4a98-9fc4-a002ad1c951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a293ebd-04db-45c6-8795-986475319c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a293ebd-04db-45c6-8795-986475319c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c013358-11f8-43f5-80b6-dfccc93a119c', 'volume_name': 'volume-3c013358-11f8-43f5-80b6-dfccc93a119c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a47d8c7-7f52-4008-9da9-3a59d0d3430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a47d8c7-7f52-4008-9da9-3a59d0d3430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465874c6-a2de-4005-8582-dfc7252d8922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Volume 3c013358-11f8-43f5-80b6-dfccc93a119c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c013358-11f8-43f5-80b6-dfccc93a119c', 'volume_size': 1} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:48 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d 1073741824" returned: 0 in 0.633s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:48 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d Sep 28 15:21:48 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (230215fe-55e0-4c35-91c9-8fa7c6f9dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2160d4-bd99-42ce-9572-40b7ada136f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2160d4-bd99-42ce-9572-40b7ada136f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-10265661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc0e34b-1347-4868-8a3e-7978286708d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:49Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a2d665-6873-470a-9d9a-17d7ed75f2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a2d665-6873-470a-9d9a-17d7ed75f2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9279516-9886-4eda-96c8-58d99277255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9279516-9886-4eda-96c8-58d99277255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc0e34b-1347-4868-8a3e-7978286708d6', 'volume_name': 'volume-edc0e34b-1347-4868-8a3e-7978286708d6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69fce79-fd9b-4972-b146-9243382ab70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69fce79-fd9b-4972-b146-9243382ab70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a132a8f6-aedd-4858-b28e-e7c055c8255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Volume edc0e34b-1347-4868-8a3e-7978286708d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc0e34b-1347-4868-8a3e-7978286708d6', 'volume_size': 1} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:48 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d" returned: 0 in 0.403s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-467299258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c013358-11f8-43f5-80b6-dfccc93a119c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:48Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Creating volume 3c013358-11f8-43f5-80b6-dfccc93a119c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:48 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c2c2cc-471f-4051-ac0e-cccb356c0e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507ac3b8-7d4c-4868-bc22-6d38fc6d4b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:48 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c 1073741824 Sep 28 15:21:48 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:48 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Volume volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d (907dd8e6-5ec2-483d-9fe2-c0812632f90d): created successfully Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507ac3b8-7d4c-4868-bc22-6d38fc6d4b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (7d58dd65-fb5e-4a9c-97ef-d812a923e1bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ae504f47-beb4-4eb9-a40a-113cd092baab tempest-CreateVolumesFromImageTest-971773144 None] Created volume successfully. Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (01543c63-3867-4021-b48b-ad4c795bfc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d23208-c29a-424b-9a77-cac7fbd1c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d23208-c29a-424b-9a77-cac7fbd1c003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1734861915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ee16ed-18ab-4f74-889b-30ea866eb965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:49Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020a76dd-63d6-4894-b2bc-39db0f12d295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020a76dd-63d6-4894-b2bc-39db0f12d295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87cedf9-5e80-4b6d-b49f-83b56e935d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87cedf9-5e80-4b6d-b49f-83b56e935d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ee16ed-18ab-4f74-889b-30ea866eb965', 'volume_name': 'volume-90ee16ed-18ab-4f74-889b-30ea866eb965', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3f7831-dd63-401e-ab0a-0f32909aa266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3f7831-dd63-401e-ab0a-0f32909aa266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efafd5b-86b9-489f-a85a-b64ec22443cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Volume 90ee16ed-18ab-4f74-889b-30ea866eb965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ee16ed-18ab-4f74-889b-30ea866eb965', 'volume_size': 1} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b18f22c7-7b9b-4e6e-8744-443bfc28eb7a tempest-GroupsTest-1037716943 None] Group tempest-Group1-1736121767: creating Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b18f22c7-7b9b-4e6e-8744-443bfc28eb7a tempest-GroupsTest-1037716943 None] Group tempest-Group1-1736121767: created successfully Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b18f22c7-7b9b-4e6e-8744-443bfc28eb7a tempest-GroupsTest-1037716943 None] Create group completed successfully. Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (2112bd58-24d5-44fc-b944-92564e0802cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3561c96e-8b22-466e-b6f8-d4a446e5937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3561c96e-8b22-466e-b6f8-d4a446e5937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768369305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ece75c-44d9-4200-8dbb-4649bec0ff6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:49Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ba2b42-f75b-423d-9a67-97c63944b258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ba2b42-f75b-423d-9a67-97c63944b258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8084f936-7f70-478a-acb4-0e00f9825f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8084f936-7f70-478a-acb4-0e00f9825f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ece75c-44d9-4200-8dbb-4649bec0ff6c', 'volume_name': 'volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d158a1d8-ce7a-4cb3-bfa0-d8edb85a1689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d158a1d8-ce7a-4cb3-bfa0-d8edb85a1689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbb7eea-670b-4f4a-b0c0-dcf2baf1edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Volume f9ece75c-44d9-4200-8dbb-4649bec0ff6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c', 'volume_size': 1} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c 1073741824" returned: 0 in 0.660s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:49 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c Sep 28 15:21:49 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c" returned: 0 in 0.281s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-10265661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc0e34b-1347-4868-8a3e-7978286708d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:49Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Creating volume edc0e34b-1347-4868-8a3e-7978286708d6 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (465874c6-a2de-4005-8582-dfc7252d8922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c013358-11f8-43f5-80b6-dfccc93a119c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef60de7c-fbf1-463d-92b6-d767f1dc2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:49 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 1073741824 Sep 28 15:21:49 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Volume volume-3c013358-11f8-43f5-80b6-dfccc93a119c (3c013358-11f8-43f5-80b6-dfccc93a119c): created successfully Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef60de7c-fbf1-463d-92b6-d767f1dc2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (848eef33-4f21-4583-b521-b8db273c4a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-12087d70-bbf4-4049-bc04-d56fabde33b6 tempest-CreateVolumesFromImageTest-971773144 None] Created volume successfully. Sep 28 15:21:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-514fde03-a364-45b8-a98e-dc9b91659ee5 tempest-GroupsTest-1037716943 None] Group tempest-Group2-1873281740: creating Sep 28 15:21:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-514fde03-a364-45b8-a98e-dc9b91659ee5 tempest-GroupsTest-1037716943 None] Group tempest-Group2-1873281740: created successfully Sep 28 15:21:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-514fde03-a364-45b8-a98e-dc9b91659ee5 tempest-GroupsTest-1037716943 None] Create group completed successfully. Sep 28 15:21:50 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 1073741824" returned: 0 in 0.531s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:50 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 Sep 28 15:21:50 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:50 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6" returned: 0 in 0.265s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1734861915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ee16ed-18ab-4f74-889b-30ea866eb965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:49Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Creating volume 90ee16ed-18ab-4f74-889b-30ea866eb965 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:50 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:50 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 1073741824 Sep 28 15:21:50 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a132a8f6-aedd-4858-b28e-e7c055c8255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc0e34b-1347-4868-8a3e-7978286708d6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7a3b3e-2dec-4a57-9f28-69a8c025e179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:50 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Volume volume-edc0e34b-1347-4868-8a3e-7978286708d6 (edc0e34b-1347-4868-8a3e-7978286708d6): created successfully Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7a3b3e-2dec-4a57-9f28-69a8c025e179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (230215fe-55e0-4c35-91c9-8fa7c6f9dccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-732b27d9-a951-44ed-884c-bab3747474ce tempest-CreateVolumesFromImageTest-971773144 None] Created volume successfully. Sep 28 15:21:51 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 1073741824" returned: 0 in 0.461s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 Sep 28 15:21:51 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965" returned: 0 in 0.325s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.052s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768369305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ece75c-44d9-4200-8dbb-4649bec0ff6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f44dce50aee40cdb2b2a2ef7dd89e25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:49Z,use_quota=True,user_id='83804a86172a4f29b20d2821d3ee831b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Creating volume f9ece75c-44d9-4200-8dbb-4649bec0ff6c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:51 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:51 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c 1073741824 Sep 28 15:21:51 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efafd5b-86b9-489f-a85a-b64ec22443cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ee16ed-18ab-4f74-889b-30ea866eb965', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847492b1-22e7-4abb-a15d-55f5788af6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:51 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Volume volume-90ee16ed-18ab-4f74-889b-30ea866eb965 (90ee16ed-18ab-4f74-889b-30ea866eb965): created successfully Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847492b1-22e7-4abb-a15d-55f5788af6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (01543c63-3867-4021-b48b-ad4c795bfc98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:51 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d1303cea-24c1-4b32-8328-e645fd9d2206 tempest-CreateVolumesFromImageTest-971773144 None] Created volume successfully. Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Flow 'volume_create_manager' (6eda4699-8be8-44b3-9573-69ac0bb397ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451026ff-2231-4cd7-9283-1be50c8d02e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451026ff-2231-4cd7-9283-1be50c8d02e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1021433316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc41846c-5dfd-4a0b-b93f-5fbf757d6c5a,host='devstack@QuobyteHD#QuobyteHD',id=3125e9ea-8ca6-40dc-95fe-68e7a483a217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67835ff503c742fbab751bd78727ac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:52Z,use_quota=True,user_id='0e4d782b62c84ecf99dd2d50af62686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4fd0f32-bd64-4820-9f48-50b9f6384a69),volume_type_id=a4fd0f32-bd64-4820-9f48-50b9f6384a69)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3e946e-e10a-4bf6-8aca-a0f09e511b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3e946e-e10a-4bf6-8aca-a0f09e511b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f77191-23dc-40e0-9611-a7e1fcfcb35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f77191-23dc-40e0-9611-a7e1fcfcb35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3125e9ea-8ca6-40dc-95fe-68e7a483a217', 'volume_name': 'volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcfb9d50-e8e9-4211-bb6a-9e4432bbf7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcfb9d50-e8e9-4211-bb6a-9e4432bbf7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fe1ef3-dcf5-474e-bafe-6205fe96d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Volume 3125e9ea-8ca6-40dc-95fe-68e7a483a217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217', 'volume_size': 1} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:52 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c 1073741824" returned: 0 in 0.580s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c Sep 28 15:21:52 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c" returned: 0 in 0.272s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bc41846c-5dfd-4a0b-b93f-5fbf757d6c5a,created_at=2026-09-28T13:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1021433316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc41846c-5dfd-4a0b-b93f-5fbf757d6c5a,host='devstack@QuobyteHD#QuobyteHD',id=3125e9ea-8ca6-40dc-95fe-68e7a483a217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67835ff503c742fbab751bd78727ac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:21:52Z,use_quota=True,user_id='0e4d782b62c84ecf99dd2d50af62686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4fd0f32-bd64-4820-9f48-50b9f6384a69),volume_type_id=a4fd0f32-bd64-4820-9f48-50b9f6384a69)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Creating volume 3125e9ea-8ca6-40dc-95fe-68e7a483a217 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:21:52 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbb7eea-670b-4f4a-b0c0-dcf2baf1edc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 1073741824 Sep 28 15:21:52 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c76be6-8da5-4ab2-8efa-7157081d3bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Volume volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c (f9ece75c-44d9-4200-8dbb-4649bec0ff6c): created successfully Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c76be6-8da5-4ab2-8efa-7157081d3bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Flow 'volume_create_manager' (2112bd58-24d5-44fc-b944-92564e0802cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e442e2be-fe5c-458c-a1cd-3822ada29923 tempest-CreateVolumesFromImageTest-971773144 None] Created volume successfully. Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-f9ece75c-44d9-4200-8dbb-4649bec0ff6c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:52 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-f9ece75c-44d9-4200-8dbb-4649bec0ff6c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-quobyte-f9ece75c-44d9-4200-8dbb-4649bec0ff6c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-f9ece75c-44d9-4200-8dbb-4649bec0ff6c" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc734f5f-5758-42a8-9851-4ab21aaf2047]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 1073741824" returned: 0 in 0.591s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 Sep 28 15:21:53 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c Sep 28 15:21:53 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217" returned: 0 in 0.301s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fe1ef3-dcf5-474e-bafe-6205fe96d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:53 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d12c852-2704-4a8b-8751-73b632031267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c" returned: 0 in 0.413s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Volume volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 (3125e9ea-8ca6-40dc-95fe-68e7a483a217): created successfully Sep 28 15:21:53 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c Sep 28 15:21:53 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d12c852-2704-4a8b-8751-73b632031267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Flow 'volume_create_manager' (6eda4699-8be8-44b3-9573-69ac0bb397ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:21:53 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1a902879-313d-41d5-8ef7-5c7b5ecfd365 tempest-GroupsTest-1037716943 None] Created volume successfully. Sep 28 15:21:53 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f9ece75c-44d9-4200-8dbb-4649bec0ff6c" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-f9ece75c-44d9-4200-8dbb-4649bec0ff6c" released by "delete_volume" :: held 0.751s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Created reservations ['3a334c96-89f9-43cd-b774-c024f42f0f91', 'd01e0c9e-c061-4d1d-8489-1d2ab28768d1', '6c4b2535-1d63-4ca1-84d8-5f35d6a73c76', '9100c4bf-666f-4856-9d86-e9968891e80b'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:53 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:53 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-90ee16ed-18ab-4f74-889b-30ea866eb965-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-90ee16ed-18ab-4f74-889b-30ea866eb965-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-quobyte-90ee16ed-18ab-4f74-889b-30ea866eb965" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:54 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-90ee16ed-18ab-4f74-889b-30ea866eb965" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.348s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Deleted volume successfully. Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0253ee-4c58-4074-8afc-bd0856315a64]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f1563770-290a-4d39-96bd-11cb4fbc5f76 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-f9ece75c-44d9-4200-8dbb-4649bec0ff6c-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:54 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 Sep 28 15:21:54 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:54 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965" returned: 0 in 0.414s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:54 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965 Sep 28 15:21:54 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90ee16ed-18ab-4f74-889b-30ea866eb965" returned: 0 in 0.261s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-90ee16ed-18ab-4f74-889b-30ea866eb965" released by "delete_volume" :: held 0.741s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Created reservations ['ab279ee2-7cd1-4095-9f74-aa53af540617', '80e379f4-a2e8-4a2b-95f7-36683c5e8b27', '4d9eb8e4-6201-483e-8ea3-03a4e578e928', '72cc5579-001e-45fe-9564-4cd9d7ad1f37'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Acquiring lock "cinder-quobyte-3125e9ea-8ca6-40dc-95fe-68e7a483a217" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Lock "cinder-quobyte-3125e9ea-8ca6-40dc-95fe-68e7a483a217" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[72de3c84-b7eb-4cdc-bc87-9a1cbfb0cc20]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:55 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 Sep 28 15:21:55 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-edc0e34b-1347-4868-8a3e-7978286708d6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-edc0e34b-1347-4868-8a3e-7978286708d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-quobyte-edc0e34b-1347-4868-8a3e-7978286708d6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-edc0e34b-1347-4868-8a3e-7978286708d6" acquired by "delete_volume" :: waited 0.036s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02485ec-e308-471f-94c3-594b4aec932b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.336s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Deleted volume successfully. Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4f1a9c97-b395-4b57-af71-508dad22dace tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-90ee16ed-18ab-4f74-889b-30ea866eb965-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:55 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 Sep 28 15:21:55 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:55 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217" returned: 0 in 0.529s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:55 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217 Sep 28 15:21:55 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6" returned: 0 in 0.499s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3125e9ea-8ca6-40dc-95fe-68e7a483a217" returned: 0 in 0.311s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6 Sep 28 15:21:56 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Lock "cinder-quobyte-3125e9ea-8ca6-40dc-95fe-68e7a483a217" released by "delete_volume" :: held 0.923s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Created reservations ['19e44710-4b33-41f3-bc52-a2c996fef069'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:56 devstack cinder-volume[86301]: WARNING cinder.quota [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1453051934 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1453051934, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:21:56 devstack cinder-volume[86301]: WARNING cinder.quota [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1453051934 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1453051934, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Created reservations ['5d3510a8-2ff4-4d41-b541-a40ccc95824f', 'd02cfe1e-001e-4f27-aeee-560d6313f0d8', '543ccbf6-686b-4c99-9d6a-9dc97fba05eb', '0b440240-f98c-4562-b51c-d7201345dfb2'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-edc0e34b-1347-4868-8a3e-7978286708d6" returned: 0 in 0.350s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-edc0e34b-1347-4868-8a3e-7978286708d6" released by "delete_volume" :: held 0.903s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:56 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:56 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Created reservations ['e039cc7c-9ee1-49fc-a75c-e6abd1487ff2', '9ae726bd-7090-417b-9da5-bcbe710114e5', 'de88d796-6207-495c-8e29-91aabb537c86', '1e03c36e-762a-4339-9ce8-694201a96abd'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:56 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-3c013358-11f8-43f5-80b6-dfccc93a119c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-3c013358-11f8-43f5-80b6-dfccc93a119c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:56 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.315s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-87df4d98-e8dc-41de-9aae-dc19b3ecfb0f tempest-GroupsTest-1037716943 None] Delete group completed successfully. Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-quobyte-3c013358-11f8-43f5-80b6-dfccc93a119c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-3c013358-11f8-43f5-80b6-dfccc93a119c" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8896c070-9825-4566-96e5-bcfa301241f7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:56 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.345s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:56 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c Sep 28 15:21:56 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Deleted volume successfully. Sep 28 15:21:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87effe6e-587f-4a64-924e-8fb8c097c367 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-edc0e34b-1347-4868-8a3e-7978286708d6-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:57 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c" returned: 0 in 0.446s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c Sep 28 15:21:57 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3c013358-11f8-43f5-80b6-dfccc93a119c" returned: 0 in 0.349s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-3c013358-11f8-43f5-80b6-dfccc93a119c" released by "delete_volume" :: held 0.856s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Created reservations ['0a3e8b13-0930-4395-a050-8c86e90563b1'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Created reservations ['61782286-5d91-45bd-945a-8c209233dce2', '36e88f1e-61ac-4deb-ac8d-62b7f44342e9', 'a2d689c7-6ee9-4922-9558-70b1e644bf6f', '225e1f07-3581-414f-8929-3ca41ddbedb9'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:57 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:57 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:57 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-907dd8e6-5ec2-483d-9fe2-c0812632f90d-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-907dd8e6-5ec2-483d-9fe2-c0812632f90d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "cinder-quobyte-907dd8e6-5ec2-483d-9fe2-c0812632f90d" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-907dd8e6-5ec2-483d-9fe2-c0812632f90d" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:21:58 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.349s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f95e9-1ff1-4429-867d-c5655a30a6db]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c87795c8-f379-4ced-822f-638e6caae793 tempest-GroupsTest-1037716943 None] Delete group completed successfully. Sep 28 15:21:58 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.334s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Deleted volume successfully. Sep 28 15:21:58 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d Sep 28 15:21:58 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f40140c2-645c-4cdf-acdf-853650fe0cb8 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-3c013358-11f8-43f5-80b6-dfccc93a119c-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:58 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d" returned: 0 in 0.487s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:58 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d Sep 28 15:21:58 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:58 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-907dd8e6-5ec2-483d-9fe2-c0812632f90d" returned: 0 in 0.395s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-quobyte-907dd8e6-5ec2-483d-9fe2-c0812632f90d" released by "delete_volume" :: held 0.965s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Created reservations ['6f17c6a4-9eab-4891-ba18-12ebdc79c896', '0f002088-3b5b-412f-adcf-17841090eb55', '707c6061-eab3-4c84-848c-33ae7b6ad52b', '5d5c7049-a044-4b97-a34c-f4731eec9fa3'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:21:59 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:21:59 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:21:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7b6a1f63-1476-40e9-8e5a-6d058e189560 tempest-GroupsTest-1037716943 None] Group tempest-GroupsTest-Group-1218209506: creating Sep 28 15:21:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7b6a1f63-1476-40e9-8e5a-6d058e189560 tempest-GroupsTest-1037716943 None] Group tempest-GroupsTest-Group-1218209506: created successfully Sep 28 15:21:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7b6a1f63-1476-40e9-8e5a-6d058e189560 tempest-GroupsTest-1037716943 None] Create group completed successfully. Sep 28 15:21:59 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.301s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:21:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Deleted volume successfully. Sep 28 15:21:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ac246fd9-3328-46fc-a34e-30040dbccdd7 tempest-CreateVolumesFromImageTest-971773144 None] Lock "cinder-907dd8e6-5ec2-483d-9fe2-c0812632f90d-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Flow 'volume_create_manager' (45c1b222-e001-41ae-834a-8c2ef690a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7277ca00-dfce-47f9-9f2e-c8f2c57a40cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7277ca00-dfce-47f9-9f2e-c8f2c57a40cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-719511172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c27bb6bd-431b-453a-99e8-dad2d2220cd4,host='devstack@QuobyteHD#QuobyteHD',id=6421cb41-d191-48df-9b26-d16cd444850a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67835ff503c742fbab751bd78727ac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:01Z,use_quota=True,user_id='0e4d782b62c84ecf99dd2d50af62686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7316187-2602-487e-a9eb-41257b74419a),volume_type_id=b7316187-2602-487e-a9eb-41257b74419a)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69479d03-e884-45c9-8031-67c445ab9ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69479d03-e884-45c9-8031-67c445ab9ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e239b654-4cda-4b5b-8901-f0c92ead5a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e239b654-4cda-4b5b-8901-f0c92ead5a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6421cb41-d191-48df-9b26-d16cd444850a', 'volume_name': 'volume-6421cb41-d191-48df-9b26-d16cd444850a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643079f2-8b7a-4ed3-8941-f34c5a404b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643079f2-8b7a-4ed3-8941-f34c5a404b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef1e939-8444-4534-aea4-ec285e9f59d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:01 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Volume 6421cb41-d191-48df-9b26-d16cd444850a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6421cb41-d191-48df-9b26-d16cd444850a', 'volume_size': 1} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c27bb6bd-431b-453a-99e8-dad2d2220cd4,created_at=2026-09-28T13:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-719511172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c27bb6bd-431b-453a-99e8-dad2d2220cd4,host='devstack@QuobyteHD#QuobyteHD',id=6421cb41-d191-48df-9b26-d16cd444850a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67835ff503c742fbab751bd78727ac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:01Z,use_quota=True,user_id='0e4d782b62c84ecf99dd2d50af62686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7316187-2602-487e-a9eb-41257b74419a),volume_type_id=b7316187-2602-487e-a9eb-41257b74419a)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Creating volume 6421cb41-d191-48df-9b26-d16cd444850a {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:01 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a 1073741824 Sep 28 15:22:01 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:01 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a 1073741824" returned: 0 in 0.571s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:01 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a Sep 28 15:22:01 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:02 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a" returned: 0 in 0.274s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef1e939-8444-4534-aea4-ec285e9f59d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6421cb41-d191-48df-9b26-d16cd444850a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b751e9-97ff-4b90-bb3f-3576f5ee058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Volume volume-6421cb41-d191-48df-9b26-d16cd444850a (6421cb41-d191-48df-9b26-d16cd444850a): created successfully Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b751e9-97ff-4b90-bb3f-3576f5ee058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Flow 'volume_create_manager' (45c1b222-e001-41ae-834a-8c2ef690a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7383d069-b956-498e-a30c-05088644541d tempest-GroupsTest-1037716943 None] Created volume successfully. Sep 28 15:22:02 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Flow 'volume_create_manager' (a3c1a1f0-f312-449e-8959-dbad6f16c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d44887-553a-4e33-8728-c0f359c968af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d44887-553a-4e33-8728-c0f359c968af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862997831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c27bb6bd-431b-453a-99e8-dad2d2220cd4,host='devstack@QuobyteHD#QuobyteHD',id=ab57ddb0-7ddd-411c-99cc-2b0685fd48d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67835ff503c742fbab751bd78727ac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:03Z,use_quota=True,user_id='0e4d782b62c84ecf99dd2d50af62686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7316187-2602-487e-a9eb-41257b74419a),volume_type_id=b7316187-2602-487e-a9eb-41257b74419a)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c498fb-2c92-4b7c-b98f-2a73fdeebbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c498fb-2c92-4b7c-b98f-2a73fdeebbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989caede-1dd9-4968-89e0-a33669064366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (989caede-1dd9-4968-89e0-a33669064366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab57ddb0-7ddd-411c-99cc-2b0685fd48d5', 'volume_name': 'volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bcf155-8c8a-4e83-b90d-36add121a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53bcf155-8c8a-4e83-b90d-36add121a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065b8eb4-6685-4fd5-a12c-b707753e0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:03 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Volume ab57ddb0-7ddd-411c-99cc-2b0685fd48d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5', 'volume_size': 1} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c27bb6bd-431b-453a-99e8-dad2d2220cd4,created_at=2026-09-28T13:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1862997831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c27bb6bd-431b-453a-99e8-dad2d2220cd4,host='devstack@QuobyteHD#QuobyteHD',id=ab57ddb0-7ddd-411c-99cc-2b0685fd48d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67835ff503c742fbab751bd78727ac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:03Z,use_quota=True,user_id='0e4d782b62c84ecf99dd2d50af62686d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7316187-2602-487e-a9eb-41257b74419a),volume_type_id=b7316187-2602-487e-a9eb-41257b74419a)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Creating volume ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:03 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:03 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 1073741824 Sep 28 15:22:03 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 1073741824" returned: 0 in 0.499s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:03 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 Sep 28 15:22:03 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:03 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5" returned: 0 in 0.312s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (065b8eb4-6685-4fd5-a12c-b707753e0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3f5ab3-2eda-4091-83c5-dcacb0bca8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:04 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Volume volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 (ab57ddb0-7ddd-411c-99cc-2b0685fd48d5): created successfully Sep 28 15:22:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3f5ab3-2eda-4091-83c5-dcacb0bca8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Flow 'volume_create_manager' (a3c1a1f0-f312-449e-8959-dbad6f16c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e7cbce20-e149-46a1-970e-6e8bac20aba2 tempest-GroupsTest-1037716943 None] Created volume successfully. Sep 28 15:22:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0f6a454e-1865-4d32-9dbb-9a47f07405e5 tempest-GroupsTest-1037716943 None] Update group completed successfully. Sep 28 15:22:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-415b9aff-92df-40c0-a403-9cb400d4beeb tempest-GroupsTest-1037716943 None] Update group completed successfully. Sep 28 15:22:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Acquiring lock "cinder-quobyte-6421cb41-d191-48df-9b26-d16cd444850a" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Lock "cinder-quobyte-6421cb41-d191-48df-9b26-d16cd444850a" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:07 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c43c0a2-67e8-46a1-af68-893b5d40e44a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:07 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a Sep 28 15:22:07 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a" returned: 0 in 0.389s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a Sep 28 15:22:08 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6421cb41-d191-48df-9b26-d16cd444850a" returned: 0 in 0.292s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Lock "cinder-quobyte-6421cb41-d191-48df-9b26-d16cd444850a" released by "delete_volume" :: held 0.742s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Acquiring lock "cinder-quobyte-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Lock "cinder-quobyte-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ee879-b3aa-49ad-86d9-99d60b43d486]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 Sep 28 15:22:08 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:08 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:08 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5 Sep 28 15:22:08 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:09 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5" returned: 0 in 0.306s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Lock "cinder-quobyte-ab57ddb0-7ddd-411c-99cc-2b0685fd48d5" released by "delete_volume" :: held 0.772s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=111,cinder:UPDATE=129,cinder:INSERT=31,cinder:DELETE=12 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=113,cinder:INSERT=28,cinder:UPDATE=139,cinder:DELETE=7 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Created reservations ['92e1074e-b1cc-44fc-95ff-b925e8918b2c'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:09 devstack cinder-volume[86301]: WARNING cinder.quota [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-875055318 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-875055318, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:22:09 devstack cinder-volume[86301]: WARNING cinder.quota [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-875055318 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-875055318, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Created reservations ['1db79d63-935b-42c0-9eff-b0f814ae1836', '6bbc0f42-de54-4d40-99cd-fc25fef302a4', 'ab5ac9eb-f51c-489c-af94-992ea7425f04', 'b93d286e-52ba-4f69-afed-31752e8bf056'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Created reservations ['0a04bab9-18d7-4e9f-a37e-da807e61a7a8', '0ae64daf-98af-4c60-8e56-d6520277151e', 'd898c268-927e-4fbb-ae75-bfb1ea39cb64', 'f82e81dd-bd61-4447-b306-96492ec774cd'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:09 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:22:09 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:09 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.266s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:09 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1bd4e44a-2c1a-4546-ae20-981baa5996df tempest-GroupsTest-1037716943 None] Delete group completed successfully. Sep 28 15:22:19 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=12,cinder:UPDATE=17,cinder:INSERT=4 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:19 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=19 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Flow 'volume_create_manager' (afcfc079-c00a-42c0-87d0-771624b76fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d785fe-31eb-463a-b9b5-9fa00279ebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9d785fe-31eb-463a-b9b5-9fa00279ebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1038514854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e7a401-f225-40ce-9a73-e12f924a7614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8a2bdbc8814918ae1dc6ff58522df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:23Z,use_quota=True,user_id='4ea0d1b2056a4d8997210bb05d30d987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecae24e5-c9c2-4d97-ab9a-959f16b8d600),volume_type_id=ecae24e5-c9c2-4d97-ab9a-959f16b8d600)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905db115-f203-4078-ba82-f30515c30eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905db115-f203-4078-ba82-f30515c30eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96e9d94-25ce-49cf-82b9-ce99d53cc1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f96e9d94-25ce-49cf-82b9-ce99d53cc1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e7a401-f225-40ce-9a73-e12f924a7614', 'volume_name': 'volume-b9e7a401-f225-40ce-9a73-e12f924a7614', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa20f50-55eb-439d-9b58-98373266119e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa20f50-55eb-439d-9b58-98373266119e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90310675-0da2-4fdb-953d-8d6cff2bd1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Volume b9e7a401-f225-40ce-9a73-e12f924a7614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e7a401-f225-40ce-9a73-e12f924a7614', 'volume_size': 1} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1038514854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e7a401-f225-40ce-9a73-e12f924a7614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8a2bdbc8814918ae1dc6ff58522df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:23Z,use_quota=True,user_id='4ea0d1b2056a4d8997210bb05d30d987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecae24e5-c9c2-4d97-ab9a-959f16b8d600),volume_type_id=ecae24e5-c9c2-4d97-ab9a-959f16b8d600)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Creating volume b9e7a401-f225-40ce-9a73-e12f924a7614 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:23 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 1073741824 Sep 28 15:22:23 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:23 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 1073741824" returned: 0 in 0.490s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:24 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 Sep 28 15:22:24 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:24 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614" returned: 0 in 0.303s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90310675-0da2-4fdb-953d-8d6cff2bd1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e7a401-f225-40ce-9a73-e12f924a7614', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df7f3e9-a41a-43fe-b4f1-a4906ad5b60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Volume volume-b9e7a401-f225-40ce-9a73-e12f924a7614 (b9e7a401-f225-40ce-9a73-e12f924a7614): created successfully Sep 28 15:22:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df7f3e9-a41a-43fe-b4f1-a4906ad5b60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Flow 'volume_create_manager' (afcfc079-c00a-42c0-87d0-771624b76fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-306094dd-7113-4592-a808-8bfbd785fa84 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Created volume successfully. Sep 28 15:22:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:25 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:22:25 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:26 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.282s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:26 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:26 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fb9a0ebc-057e-4b8a-8550-3ecd31f836f8 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Retype volume completed successfully. Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Acquiring lock "cinder-b9e7a401-f225-40ce-9a73-e12f924a7614-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "cinder-b9e7a401-f225-40ce-9a73-e12f924a7614-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Acquiring lock "cinder-quobyte-b9e7a401-f225-40ce-9a73-e12f924a7614" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "cinder-quobyte-b9e7a401-f225-40ce-9a73-e12f924a7614" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a2a59c-9391-4ba2-8c8a-4e818b1edf1b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:27 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 Sep 28 15:22:27 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:27 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614" returned: 0 in 0.409s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:27 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614 Sep 28 15:22:27 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:27 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9e7a401-f225-40ce-9a73-e12f924a7614" returned: 0 in 0.285s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "cinder-quobyte-b9e7a401-f225-40ce-9a73-e12f924a7614" released by "delete_volume" :: held 0.745s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:28 devstack cinder-volume[86301]: WARNING cinder.quota [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:22:28 devstack cinder-volume[86301]: WARNING cinder.quota [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Created reservations ['f1654b01-69a5-4412-8f62-efc8861ce5b0', '1cbbcf90-db62-49c3-9ac2-7167779e039c', '6e56d6ec-66db-4417-ab96-8e3b2fc1e80a', 'ceeb2556-caae-49fe-b358-03c80fab11f9'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:28 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:22:28 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:28 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.322s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Deleted volume successfully. Sep 28 15:22:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7175247b-ca3a-49d3-97dc-14a74df67593 tempest-VolumeRetypeWithoutMigrationTest-1930950274 None] Lock "cinder-b9e7a401-f225-40ce-9a73-e12f924a7614-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Flow 'volume_create_manager' (15fa1ab8-3beb-4f71-b88f-d4df37bd6ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59f3581-3f8b-4d14-ae1b-c88b96f52da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59f3581-3f8b-4d14-ae1b-c88b96f52da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2045478235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427789d7-b1b1-4f71-9153-fc18f018b349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a42a327e1ea461bb28837bd49eac008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:46Z,use_quota=True,user_id='f6dcdb03dc13452a9c3e32915f196132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee437ef7-d0e1-4ca0-8d80-a3ef0e097aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee437ef7-d0e1-4ca0-8d80-a3ef0e097aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2034cf92-6f87-46a3-9f21-5fe69665f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2034cf92-6f87-46a3-9f21-5fe69665f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427789d7-b1b1-4f71-9153-fc18f018b349', 'volume_name': 'volume-427789d7-b1b1-4f71-9153-fc18f018b349', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525fe264-5396-40dc-8b16-4e7ffd1b359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525fe264-5396-40dc-8b16-4e7ffd1b359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ecc40-9b00-4465-bf12-ce03528496a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:46 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Volume 427789d7-b1b1-4f71-9153-fc18f018b349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427789d7-b1b1-4f71-9153-fc18f018b349', 'volume_size': 1} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2045478235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427789d7-b1b1-4f71-9153-fc18f018b349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a42a327e1ea461bb28837bd49eac008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:46Z,use_quota=True,user_id='f6dcdb03dc13452a9c3e32915f196132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Creating volume 427789d7-b1b1-4f71-9153-fc18f018b349 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:46 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 1073741824 Sep 28 15:22:46 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:46 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 1073741824" returned: 0 in 0.412s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:46 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 Sep 28 15:22:46 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349" returned: 0 in 0.252s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9ecc40-9b00-4465-bf12-ce03528496a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427789d7-b1b1-4f71-9153-fc18f018b349', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b464381-28f6-46a2-be72-98b2f8791e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:47 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Volume volume-427789d7-b1b1-4f71-9153-fc18f018b349 (427789d7-b1b1-4f71-9153-fc18f018b349): created successfully Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b464381-28f6-46a2-be72-98b2f8791e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Flow 'volume_create_manager' (15fa1ab8-3beb-4f71-b88f-d4df37bd6ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:47 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f8419247-7112-4eb1-9e23-efdf04b370f3 tempest-AbsoluteLimitsTests-1630324664 None] Created volume successfully. Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:22:47 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Acquiring lock "cinder-427789d7-b1b1-4f71-9153-fc18f018b349-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Lock "cinder-427789d7-b1b1-4f71-9153-fc18f018b349-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.355s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Acquiring lock "cinder-quobyte-427789d7-b1b1-4f71-9153-fc18f018b349" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Lock "cinder-quobyte-427789d7-b1b1-4f71-9153-fc18f018b349" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f81aa0-21f0-496d-9fed-eb6aa07d4286]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:47 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 Sep 28 15:22:47 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349" returned: 0 in 0.409s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349 Sep 28 15:22:48 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-427789d7-b1b1-4f71-9153-fc18f018b349" returned: 0 in 0.280s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Lock "cinder-quobyte-427789d7-b1b1-4f71-9153-fc18f018b349" released by "delete_volume" :: held 0.734s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Created reservations ['957a6454-c2c6-405a-89ab-be509fb04636', '3bd409b8-4fe8-49af-a5a1-785ed0737882', 'e9578f1f-4bef-46b1-a4da-149589b8dc1b', '1ab62d1a-02fa-426b-8b43-697147c2335f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:48 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:22:48 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:48 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.298s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:22:48 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Deleted volume successfully. Sep 28 15:22:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2f1fb878-a94f-4339-93f9-f449f19d23a0 tempest-AbsoluteLimitsTests-1630324664 None] Lock "cinder-427789d7-b1b1-4f71-9153-fc18f018b349-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Flow 'volume_create_manager' (f5e27985-c264-4a3a-a6af-7002d9f18355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f5a6bd-5579-4105-803e-8045de2201e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f5a6bd-5579-4105-803e-8045de2201e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1986811310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebf1025-931a-41b0-ae11-9fe91147a305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c36bee813f4e889cc4c9416db1f419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:56Z,use_quota=True,user_id='17512e1e0f4e497580f757e8124881ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816d5d01-2232-486c-a342-53a837c9e4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816d5d01-2232-486c-a342-53a837c9e4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e052e0c7-d04f-4746-9269-7d17ed7b51bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e052e0c7-d04f-4746-9269-7d17ed7b51bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ebf1025-931a-41b0-ae11-9fe91147a305', 'volume_name': 'volume-3ebf1025-931a-41b0-ae11-9fe91147a305', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce91d03f-7bfd-438c-a41e-ea33e9f3ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce91d03f-7bfd-438c-a41e-ea33e9f3ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab75a2b-26c4-4f57-b184-43b078bf4c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:55 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Volume 3ebf1025-931a-41b0-ae11-9fe91147a305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ebf1025-931a-41b0-ae11-9fe91147a305', 'volume_size': 1} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1986811310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebf1025-931a-41b0-ae11-9fe91147a305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c36bee813f4e889cc4c9416db1f419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:22:56Z,use_quota=True,user_id='17512e1e0f4e497580f757e8124881ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Creating volume 3ebf1025-931a-41b0-ae11-9fe91147a305 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:22:55 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:22:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:55 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 1073741824 Sep 28 15:22:55 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 1073741824" returned: 0 in 0.501s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:56 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 Sep 28 15:22:56 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:56 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305" returned: 0 in 0.280s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab75a2b-26c4-4f57-b184-43b078bf4c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ebf1025-931a-41b0-ae11-9fe91147a305', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308554bc-8843-4f5f-957e-c9d8c4d2ea8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:22:56 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Volume volume-3ebf1025-931a-41b0-ae11-9fe91147a305 (3ebf1025-931a-41b0-ae11-9fe91147a305): created successfully Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308554bc-8843-4f5f-957e-c9d8c4d2ea8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:22:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Flow 'volume_create_manager' (f5e27985-c264-4a3a-a6af-7002d9f18355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:22:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a641db51-9add-46ed-94f5-077a77e3e014 tempest-VolumesTransfersTest-593486299 None] Created volume successfully. Sep 28 15:22:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-159f4e95-af6a-4aa4-afaf-7d20ed659459 tempest-VolumesTransfersTest-866799874 None] Transfer volume completed successfully. Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Acquiring lock "cinder-3ebf1025-931a-41b0-ae11-9fe91147a305-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-3ebf1025-931a-41b0-ae11-9fe91147a305-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Acquiring lock "cinder-quobyte-3ebf1025-931a-41b0-ae11-9fe91147a305" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-quobyte-3ebf1025-931a-41b0-ae11-9fe91147a305" acquired by "delete_volume" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fab58b2-ef8c-4d65-8cc8-1fafb7f1da80]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 Sep 28 15:22:59 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:22:59 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305" returned: 0 in 0.415s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:22:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:22:59 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305 Sep 28 15:22:59 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3ebf1025-931a-41b0-ae11-9fe91147a305" returned: 0 in 0.285s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-quobyte-3ebf1025-931a-41b0-ae11-9fe91147a305" released by "delete_volume" :: held 0.749s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Created reservations ['3e955ec4-c8fe-448a-a1f7-7ed8fe7c4323', '9e1ad0f6-e387-4b27-a98f-d3ff74ba373b', '21f10cd1-1949-479b-af00-72bc64f1a074', 'cf6cd6e6-29b0-4e57-9515-0c8e08fee60d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:00 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:00 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:00 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.282s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Deleted volume successfully. Sep 28 15:23:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-48277dbd-3077-457f-a380-3631ce76bcf8 tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-3ebf1025-931a-41b0-ae11-9fe91147a305-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Flow 'volume_create_manager' (7b7b2bc3-2bca-49a2-a37c-e828f70adac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88db6f0-2897-4a1b-b0e0-f4590b937da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e88db6f0-2897-4a1b-b0e0-f4590b937da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-161785568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17866917-49fd-4ff6-a273-4bb6bf1ec63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c36bee813f4e889cc4c9416db1f419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:01Z,use_quota=True,user_id='17512e1e0f4e497580f757e8124881ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd1d826-1c94-4c83-9673-ba75d841bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd1d826-1c94-4c83-9673-ba75d841bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954af4e4-6173-4c57-9cb4-8268c20c6dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954af4e4-6173-4c57-9cb4-8268c20c6dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17866917-49fd-4ff6-a273-4bb6bf1ec63c', 'volume_name': 'volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084b2d17-f4f8-4ffd-a1d1-006756d0546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084b2d17-f4f8-4ffd-a1d1-006756d0546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e8d13a-4b3e-47a2-bc97-6c98bb9dc6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:01 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Volume 17866917-49fd-4ff6-a273-4bb6bf1ec63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c', 'volume_size': 1} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-161785568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17866917-49fd-4ff6-a273-4bb6bf1ec63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41c36bee813f4e889cc4c9416db1f419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:01Z,use_quota=True,user_id='17512e1e0f4e497580f757e8124881ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Creating volume 17866917-49fd-4ff6-a273-4bb6bf1ec63c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:01 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c 1073741824 Sep 28 15:23:01 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:01 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c 1073741824" returned: 0 in 0.582s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:01 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c Sep 28 15:23:01 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:02 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c" returned: 0 in 0.318s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e8d13a-4b3e-47a2-bc97-6c98bb9dc6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4e59da-a738-404f-9baa-dc8a55d4fee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Volume volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c (17866917-49fd-4ff6-a273-4bb6bf1ec63c): created successfully Sep 28 15:23:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4e59da-a738-404f-9baa-dc8a55d4fee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Flow 'volume_create_manager' (7b7b2bc3-2bca-49a2-a37c-e828f70adac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2b3a2bc1-e640-4904-bf22-8a36b7689f2c tempest-VolumesTransfersTest-593486299 None] Created volume successfully. Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Acquiring lock "cinder-17866917-49fd-4ff6-a273-4bb6bf1ec63c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-17866917-49fd-4ff6-a273-4bb6bf1ec63c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Acquiring lock "cinder-quobyte-17866917-49fd-4ff6-a273-4bb6bf1ec63c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-quobyte-17866917-49fd-4ff6-a273-4bb6bf1ec63c" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf64552-7b06-4e97-b331-4e1ddec1d1b8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c Sep 28 15:23:03 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:03 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c" returned: 0 in 0.411s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:03 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c Sep 28 15:23:03 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-17866917-49fd-4ff6-a273-4bb6bf1ec63c" returned: 0 in 0.319s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-quobyte-17866917-49fd-4ff6-a273-4bb6bf1ec63c" released by "delete_volume" :: held 0.778s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Created reservations ['e7392698-2c18-4d23-8204-f34f70c009d4', '28aafd9b-52f3-4cbe-a7a9-b7b475bda434', '9a89e4fc-2865-42dc-b648-5290629bb611', 'c4c19e9d-accb-4df3-a209-bd36d2ec0078'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:04 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:04 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:04 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.335s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Deleted volume successfully. Sep 28 15:23:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ade85299-123f-4826-aeaf-2e3e6882afdf tempest-VolumesTransfersTest-1332769905 None] Lock "cinder-17866917-49fd-4ff6-a273-4bb6bf1ec63c-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Flow 'volume_create_manager' (1359a9f0-b3db-4cd6-96e7-8380baa4201c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffb0aa9-d1a4-4223-815b-54266deb04cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffb0aa9-d1a4-4223-815b-54266deb04cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1577994931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0007fd-4e94-4a91-8c3f-5ed7853518b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abe7429eb1d4183a7306c7b38d55748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:13Z,use_quota=True,user_id='3b1f1b1dd4fa44138b6836d2f8fc0b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2094d33e-4409-4549-b110-0141c480939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2094d33e-4409-4549-b110-0141c480939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995c6d29-86f9-46e3-bc5d-db18d2a50875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995c6d29-86f9-46e3-bc5d-db18d2a50875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae0007fd-4e94-4a91-8c3f-5ed7853518b8', 'volume_name': 'volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bb5524-a1ae-4aed-a884-6308414225f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92bb5524-a1ae-4aed-a884-6308414225f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed423760-9ce4-4649-a697-8130edbaf59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Volume ae0007fd-4e94-4a91-8c3f-5ed7853518b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8', 'volume_size': 1} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1577994931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae0007fd-4e94-4a91-8c3f-5ed7853518b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abe7429eb1d4183a7306c7b38d55748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:13Z,use_quota=True,user_id='3b1f1b1dd4fa44138b6836d2f8fc0b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Creating volume ae0007fd-4e94-4a91-8c3f-5ed7853518b8 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:13 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 1073741824 Sep 28 15:23:13 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:13 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 1073741824" returned: 0 in 0.437s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:13 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 Sep 28 15:23:13 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:14 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8" returned: 0 in 0.343s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed423760-9ce4-4649-a697-8130edbaf59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc9f4d2-1667-4e42-83a3-74517396a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:14 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Volume volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 (ae0007fd-4e94-4a91-8c3f-5ed7853518b8): created successfully Sep 28 15:23:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc9f4d2-1667-4e42-83a3-74517396a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Flow 'volume_create_manager' (1359a9f0-b3db-4cd6-96e7-8380baa4201c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-82092b51-74ff-45c9-81f6-0a1a215c5194 tempest-VolumesTransfersV355Test-1228440146 None] Created volume successfully. Sep 28 15:23:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-06cec93c-a6d3-4116-b210-53ae87707125 tempest-VolumesTransfersV355Test-699586500 None] Transfer volume completed successfully. Sep 28 15:23:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Acquiring lock "cinder-ae0007fd-4e94-4a91-8c3f-5ed7853518b8-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-ae0007fd-4e94-4a91-8c3f-5ed7853518b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Acquiring lock "cinder-quobyte-ae0007fd-4e94-4a91-8c3f-5ed7853518b8" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-quobyte-ae0007fd-4e94-4a91-8c3f-5ed7853518b8" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:16 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a9bef-ad4b-46ea-84f6-608146c3912d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:16 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 Sep 28 15:23:16 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8 Sep 28 15:23:17 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ae0007fd-4e94-4a91-8c3f-5ed7853518b8" returned: 0 in 0.307s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-quobyte-ae0007fd-4e94-4a91-8c3f-5ed7853518b8" released by "delete_volume" :: held 0.753s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Created reservations ['03cdaa9c-ee99-4aa8-b435-1bb07caf92fe', '8f37f7b3-9a6c-43c6-bc5c-35b8fb656958', 'ef116de4-48b8-428f-bca1-73e2f78402eb', 'd7e09a14-e34c-41dc-90e7-9b16b0ade51c'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:17 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:17 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:17 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.255s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:17 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Deleted volume successfully. Sep 28 15:23:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b881de7f-92f7-4b91-a4eb-be08a5618295 tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-ae0007fd-4e94-4a91-8c3f-5ed7853518b8-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Flow 'volume_create_manager' (54450eda-0d1e-4e7d-a665-97c9f863e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6444191-fb53-4582-ad83-06c69d8acf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6444191-fb53-4582-ad83-06c69d8acf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2093191292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c628b42-45a4-41cf-8ec4-175514581732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abe7429eb1d4183a7306c7b38d55748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:18Z,use_quota=True,user_id='3b1f1b1dd4fa44138b6836d2f8fc0b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472e0332-d3c5-4c97-a1c6-e46923b6f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472e0332-d3c5-4c97-a1c6-e46923b6f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ab9977-498f-480d-83b4-9b062a0e1990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ab9977-498f-480d-83b4-9b062a0e1990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c628b42-45a4-41cf-8ec4-175514581732', 'volume_name': 'volume-1c628b42-45a4-41cf-8ec4-175514581732', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93314b0b-cc0e-446b-8428-dd95ec651cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93314b0b-cc0e-446b-8428-dd95ec651cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37052b64-7ea1-421f-8ce8-9700fae70b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:18 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Volume 1c628b42-45a4-41cf-8ec4-175514581732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c628b42-45a4-41cf-8ec4-175514581732', 'volume_size': 1} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2093191292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c628b42-45a4-41cf-8ec4-175514581732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abe7429eb1d4183a7306c7b38d55748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:18Z,use_quota=True,user_id='3b1f1b1dd4fa44138b6836d2f8fc0b82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Creating volume 1c628b42-45a4-41cf-8ec4-175514581732 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:18 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:23:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:18 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 1073741824 Sep 28 15:23:18 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 1073741824" returned: 0 in 0.541s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:19 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 Sep 28 15:23:19 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:19 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732" returned: 0 in 0.327s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37052b64-7ea1-421f-8ce8-9700fae70b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c628b42-45a4-41cf-8ec4-175514581732', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05af27e6-5bdd-4000-8de5-da11244fbcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:19 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Volume volume-1c628b42-45a4-41cf-8ec4-175514581732 (1c628b42-45a4-41cf-8ec4-175514581732): created successfully Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05af27e6-5bdd-4000-8de5-da11244fbcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:19 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Flow 'volume_create_manager' (54450eda-0d1e-4e7d-a665-97c9f863e454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-77e9e6b7-7fe8-4f08-8633-b4aa5936f3f6 tempest-VolumesTransfersV355Test-1228440146 None] Created volume successfully. Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Acquiring lock "cinder-1c628b42-45a4-41cf-8ec4-175514581732-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-1c628b42-45a4-41cf-8ec4-175514581732-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=58,cinder:SELECT=53,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=39,cinder:UPDATE=69,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Acquiring lock "cinder-quobyte-1c628b42-45a4-41cf-8ec4-175514581732" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-quobyte-1c628b42-45a4-41cf-8ec4-175514581732" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aaf725-3b29-41c6-b0b8-b7803aaba611]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 Sep 28 15:23:21 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732" returned: 0 in 0.397s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732 Sep 28 15:23:21 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-1c628b42-45a4-41cf-8ec4-175514581732" returned: 0 in 0.240s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-quobyte-1c628b42-45a4-41cf-8ec4-175514581732" released by "delete_volume" :: held 0.684s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Created reservations ['d44e2e4c-525f-4db5-b3a2-670c53c33fb7', '9b7653c8-7ffa-46e9-a09c-4e91e102ec23', 'c192401c-f1c6-436a-b25a-d64ee1ebdda4', 'd5baeee7-81c6-4b3f-a27d-5293bf9061d9'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:21 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:21 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:21 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.271s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:21 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Deleted volume successfully. Sep 28 15:23:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-90e9a8a3-9a4e-4979-9dbb-00b4cb391d8a tempest-VolumesTransfersV355Test-1512415954 None] Lock "cinder-1c628b42-45a4-41cf-8ec4-175514581732-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (7e1c75e5-d12d-4b4e-a75a-fd54ec74188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7f225a-e7dc-4036-b20b-fdf9f1befeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7f225a-e7dc-4036-b20b-fdf9f1befeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-264161208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e4f49b-70cc-4037-9761-16cc66235228,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:29Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e74832-adcc-4934-91b9-4c31abc703ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e74832-adcc-4934-91b9-4c31abc703ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcfae11-9f99-41f7-8237-880d616f8d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcfae11-9f99-41f7-8237-880d616f8d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e4f49b-70cc-4037-9761-16cc66235228', 'volume_name': 'volume-a1e4f49b-70cc-4037-9761-16cc66235228', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d1fae6-4d55-4c0a-80bb-09d1662357e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d1fae6-4d55-4c0a-80bb-09d1662357e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6628b74b-59c6-44ca-ba64-8ef26e77a01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Volume a1e4f49b-70cc-4037-9761-16cc66235228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e4f49b-70cc-4037-9761-16cc66235228', 'volume_size': 1} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-264161208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e4f49b-70cc-4037-9761-16cc66235228,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:29Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Creating volume a1e4f49b-70cc-4037-9761-16cc66235228 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:29 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:29 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 1073741824 Sep 28 15:23:29 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:29 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 1073741824" returned: 0 in 0.495s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:29 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 Sep 28 15:23:29 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:30 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228" returned: 0 in 0.328s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6628b74b-59c6-44ca-ba64-8ef26e77a01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e4f49b-70cc-4037-9761-16cc66235228', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faaa1bb0-e3a1-475c-997d-43e6093b6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Volume volume-a1e4f49b-70cc-4037-9761-16cc66235228 (a1e4f49b-70cc-4037-9761-16cc66235228): created successfully Sep 28 15:23:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faaa1bb0-e3a1-475c-997d-43e6093b6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (7e1c75e5-d12d-4b4e-a75a-fd54ec74188b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-020b7af8-3da8-452c-98bf-cfe452cf075a tempest-VolumesGetTest-1762514730 None] Created volume successfully. Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (6df699ba-6b90-4be2-878b-566a0f508b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184a81f7-4034-4d99-84d0-c6703edef37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184a81f7-4034-4d99-84d0-c6703edef37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1177955192',display_name='tempest-VolumesGetTest-Volume-730789681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:32Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02887b7-29b8-4370-a5e0-5c345178256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02887b7-29b8-4370-a5e0-5c345178256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef6c21b-9320-4c3b-b683-7ecb9098be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef6c21b-9320-4c3b-b683-7ecb9098be59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6', 'volume_name': 'volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabe39a0-4925-463a-a8e0-32b07a2bf8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabe39a0-4925-463a-a8e0-32b07a2bf8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762f491b-1ee6-4c5a-978d-8bbbf325b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Volume 63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6', 'volume_size': 1} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1177955192',display_name='tempest-VolumesGetTest-Volume-730789681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:32Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Creating volume 63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:32 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:32 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 1073741824 Sep 28 15:23:32 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:32 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 1073741824" returned: 0 in 0.534s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:33 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 Sep 28 15:23:33 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:33 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6" returned: 0 in 0.308s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (762f491b-1ee6-4c5a-978d-8bbbf325b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633ac1d6-b350-4fcc-860c-7c1ae8d1b3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:33 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Volume volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 (63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6): created successfully Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633ac1d6-b350-4fcc-860c-7c1ae8d1b3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (6df699ba-6b90-4be2-878b-566a0f508b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-eca68699-f500-43cb-b28b-1e33f61a7bdb tempest-VolumesGetTest-1762514730 None] Created volume successfully. Sep 28 15:23:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Lock "cinder-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e91169-231e-432b-b380-4cbf4bb88064]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:34 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 Sep 28 15:23:34 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6 Sep 28 15:23:35 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6" returned: 0 in 0.264s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6" released by "delete_volume" :: held 0.712s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Created reservations ['5588ef69-b1c4-4196-9eb5-1ab5480eb007', '3ff57e92-ccdb-4852-8df2-ccd6a2fd9a33', 'c5b8b7ba-8bfc-42ec-8c26-017b1fda4788', '7be66c57-7f10-435c-adf3-5be2256f6031'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:35 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:35 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:35 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.313s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-a1e4f49b-70cc-4037-9761-16cc66235228-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Deleted volume successfully. Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Lock "cinder-a1e4f49b-70cc-4037-9761-16cc66235228-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3976779-ada9-48d1-86ee-c9fbc0a2ca08 tempest-VolumesGetTest-1762514730 None] Lock "cinder-63bcc5bc-5e1a-460c-a6c8-71db0cbd22b6-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-a1e4f49b-70cc-4037-9761-16cc66235228" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-a1e4f49b-70cc-4037-9761-16cc66235228" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[062436d3-a17e-403e-863b-3ada42a96aa2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 Sep 28 15:23:36 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228 Sep 28 15:23:36 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:36 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a1e4f49b-70cc-4037-9761-16cc66235228" returned: 0 in 0.258s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-a1e4f49b-70cc-4037-9761-16cc66235228" released by "delete_volume" :: held 0.704s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Created reservations ['946b7eba-07a5-4a9c-a1a1-fd11a248cc60', '70aecc1f-08d7-4f18-a644-8155882bc919', '703aac1f-a033-4c21-8200-f8c248ec3847', '499ae52e-1cc0-4fd0-8815-26295dd81303'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:36 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:36 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:37 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.268s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Deleted volume successfully. Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-36a6087a-d38f-488e-820b-9a543187cfd9 tempest-VolumesGetTest-1762514730 None] Lock "cinder-a1e4f49b-70cc-4037-9761-16cc66235228-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (dc6e3779-1a2a-4ef9-963b-ce2e7eb798e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d928b38f-3a08-4ad8-bfd0-08354fafaa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d928b38f-3a08-4ad8-bfd0-08354fafaa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-761730483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d36195-11d8-4a28-a4b1-bdb3f0972e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:38Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e637300e-7c75-4443-9dc6-66d3bb09e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e637300e-7c75-4443-9dc6-66d3bb09e549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb57230-12f5-4e19-ab28-3c34c0cec421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb57230-12f5-4e19-ab28-3c34c0cec421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40d36195-11d8-4a28-a4b1-bdb3f0972e94', 'volume_name': 'volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b73016-e62e-4f79-97ab-97d9f085134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b73016-e62e-4f79-97ab-97d9f085134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff707464-c866-4626-8969-807242da0864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:37 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Volume 40d36195-11d8-4a28-a4b1-bdb3f0972e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94', 'volume_size': 1} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-761730483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40d36195-11d8-4a28-a4b1-bdb3f0972e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:38Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Creating volume 40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:37 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:23:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:37 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 1073741824 Sep 28 15:23:37 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 1073741824" returned: 0 in 0.466s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:38 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 Sep 28 15:23:38 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:38 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94" returned: 0 in 0.259s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff707464-c866-4626-8969-807242da0864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa16c34-bd57-418d-bf36-7f908722d50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:38 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Volume volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 (40d36195-11d8-4a28-a4b1-bdb3f0972e94): created successfully Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa16c34-bd57-418d-bf36-7f908722d50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (dc6e3779-1a2a-4ef9-963b-ce2e7eb798e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cf952046-3d30-4880-878f-0095a5c17765 tempest-VolumesGetTest-1762514730 None] Created volume successfully. Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (5cdd2fbc-fafe-41fc-ae9b-6be17bed37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818e93d4-0404-4443-8e2c-013c6b0710d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818e93d4-0404-4443-8e2c-013c6b0710d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1649423429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a573e7-4224-4a16-937e-407ff4c8e322,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=40d36195-11d8-4a28-a4b1-bdb3f0972e94,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:39Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f82913b-9e6b-4f45-a0b9-5abd8b83872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f82913b-9e6b-4f45-a0b9-5abd8b83872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debb3702-7089-4299-a67a-61fb46036eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debb3702-7089-4299-a67a-61fb46036eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '95a573e7-4224-4a16-937e-407ff4c8e322', 'volume_name': 'volume-95a573e7-4224-4a16-937e-407ff4c8e322', 'volume_size': 1, 'source_volid': '40d36195-11d8-4a28-a4b1-bdb3f0972e94', 'source_volstatus': 'available'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bbec3a-6a4d-4441-be22-734db810ad66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bbec3a-6a4d-4441-be22-734db810ad66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adef0b0-4767-4f84-83a1-adaecdef4e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:39 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Volume 95a573e7-4224-4a16-937e-407ff4c8e322: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-95a573e7-4224-4a16-937e-407ff4c8e322', 'volume_size': 1, 'source_volid': '40d36195-11d8-4a28-a4b1-bdb3f0972e94', 'source_volstatus': 'available'} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:39 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Cloning volume 40d36195-11d8-4a28-a4b1-bdb3f0972e94 to volume 95a573e7-4224-4a16-937e-407ff4c8e322 Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Creating offline snapshot 3e25c06e-d374-43d6-95cb-9f95986733d5 of volume 40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b91a38-1ee2-4ac8-8e23-c49411954596]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 Sep 28 15:23:39 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:39 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94" returned: 0 in 0.386s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:39 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 1G Sep 28 15:23:39 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 1G" returned: 0 in 0.453s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 Sep 28 15:23:40 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5" returned: 0 in 0.323s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 is being set with open permissions: ugo+rw Sep 28 15:23:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 Sep 28 15:23:40 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:40 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:40 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.info Sep 28 15:23:40 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.info" returned: 0 in 0.258s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.info is being set with open permissions: ugo+rw Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.info Sep 28 15:23:41 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.info" returned: 0 in 0.247s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-95a573e7-4224-4a16-937e-407ff4c8e322" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-95a573e7-4224-4a16-937e-407ff4c8e322" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] snapshot: 3e25c06e-d374-43d6-95cb-9f95986733d5, volume: 95a573e7-4224-4a16-937e-407ff4c8e322, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099658c-3cf2-4088-97b7-ad1213cfe360]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 Sep 28 15:23:41 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:41 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5" returned: 0 in 0.371s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca975156-499a-438c-8a7b-38b1df23ab32]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:41 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 Sep 28 15:23:41 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:42 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94" returned: 0 in 0.368s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:23:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:23:42 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:23:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:42 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 Sep 28 15:23:42 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:47 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:47 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:47 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.644s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:23:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:23:48 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322" returned: 0 in 6.529s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:23:48 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Converted 1024.00 MB image at 156.82 MB/s Sep 28 15:23:48 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 is being set with open permissions: ugo+rw Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:48 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 Sep 28 15:23:48 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:48 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322" returned: 0 in 0.283s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-95a573e7-4224-4a16-937e-407ff4c8e322" released by "_copy_volume_from_snapshot" :: held 7.618s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-3e25c06e-d374-43d6-95cb-9f95986733d5" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-3e25c06e-d374-43d6-95cb-9f95986733d5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Deleting offline snapshot 3e25c06e-d374-43d6-95cb-9f95986733d5 of volume 40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] snapshot_file for this snap is: volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf29ce4-96b1-495d-a8c6-698992d8c528]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 Sep 28 15:23:49 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5" returned: 0 in 0.376s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb47728-0fbf-403a-8193-224fc813921b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 Sep 28 15:23:49 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:49 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94" returned: 0 in 0.552s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:49 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 Sep 28 15:23:49 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5" returned: 0 in 0.353s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:50 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5 Sep 28 15:23:50 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:50 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94.3e25c06e-d374-43d6-95cb-9f95986733d5" returned: 0 in 0.261s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-3e25c06e-d374-43d6-95cb-9f95986733d5" released by "_delete_snapshot" :: held 1.644s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.407s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adef0b0-4767-4f84-83a1-adaecdef4e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a573e7-4224-4a16-937e-407ff4c8e322', 'volume_size': 1, 'source_volid': '40d36195-11d8-4a28-a4b1-bdb3f0972e94', 'source_volstatus': 'available'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc38b001-7032-4891-81f6-7a386fcce1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:50 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Volume volume-95a573e7-4224-4a16-937e-407ff4c8e322 (95a573e7-4224-4a16-937e-407ff4c8e322): created successfully Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc38b001-7032-4891-81f6-7a386fcce1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:50 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (5cdd2fbc-fafe-41fc-ae9b-6be17bed37d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:50 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b2c7df8a-ca5f-47e4-a00f-8a1749ef880a tempest-VolumesGetTest-1762514730 None] Created volume successfully. Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (063b4237-200c-4694-ba1e-83451f2e1c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb698de-2bc4-4f07-9066-66ce9dbcfc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb698de-2bc4-4f07-9066-66ce9dbcfc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-733574059',display_name='tempest-VolumesGetTest-Volume-910891988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10337c15-3e6b-486b-a7c6-94ad4db1926e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:52Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81606449-d0bd-413c-bfcf-832532bee02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81606449-d0bd-413c-bfcf-832532bee02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229d5acf-7b71-4481-9fcc-21ae6449abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (229d5acf-7b71-4481-9fcc-21ae6449abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10337c15-3e6b-486b-a7c6-94ad4db1926e', 'volume_name': 'volume-10337c15-3e6b-486b-a7c6-94ad4db1926e', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c3275d-773f-4993-a14d-0c0d3205faca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c3275d-773f-4993-a14d-0c0d3205faca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbac4ca-1bcc-404d-ba13-30bfbc9ecfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:51 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Volume 10337c15-3e6b-486b-a7c6-94ad4db1926e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10337c15-3e6b-486b-a7c6-94ad4db1926e', 'volume_size': 1} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-733574059',display_name='tempest-VolumesGetTest-Volume-910891988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10337c15-3e6b-486b-a7c6-94ad4db1926e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:52Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Creating volume 10337c15-3e6b-486b-a7c6-94ad4db1926e {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:23:51 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:23:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e 1073741824 Sep 28 15:23:52 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:52 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e 1073741824" returned: 0 in 0.512s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:52 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e Sep 28 15:23:52 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:52 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e" returned: 0 in 0.264s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbac4ca-1bcc-404d-ba13-30bfbc9ecfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10337c15-3e6b-486b-a7c6-94ad4db1926e', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d55bb-526a-4f49-a0ab-efa245d5a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Volume volume-10337c15-3e6b-486b-a7c6-94ad4db1926e (10337c15-3e6b-486b-a7c6-94ad4db1926e): created successfully Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28d55bb-526a-4f49-a0ab-efa245d5a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (063b4237-200c-4694-ba1e-83451f2e1c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b69c9ba3-752b-49a2-ada6-78e7158ae199 tempest-VolumesGetTest-1762514730 None] Created volume successfully. Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-10337c15-3e6b-486b-a7c6-94ad4db1926e-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Lock "cinder-10337c15-3e6b-486b-a7c6-94ad4db1926e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-10337c15-3e6b-486b-a7c6-94ad4db1926e" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-10337c15-3e6b-486b-a7c6-94ad4db1926e" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5521c-9b4b-478e-913c-79e07785dcab]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e Sep 28 15:23:54 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e" returned: 0 in 0.405s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:54 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e Sep 28 15:23:54 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:54 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-10337c15-3e6b-486b-a7c6-94ad4db1926e" returned: 0 in 0.263s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-10337c15-3e6b-486b-a7c6-94ad4db1926e" released by "delete_volume" :: held 0.713s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Created reservations ['e6f39b39-8469-4dfa-a725-6264288fcd65', 'aee3217e-ef26-4e70-9c2f-2ef5d141d1f7', 'f42f96f7-60d0-4cad-a15a-3f703a3b16d3', '36b4f7e3-47a0-41de-a888-1e1c8064d5e7'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:55 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:55 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.281s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Deleted volume successfully. Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3b31f221-9778-4a12-9f44-5b6cd90ef24f tempest-VolumesGetTest-1762514730 None] Lock "cinder-10337c15-3e6b-486b-a7c6-94ad4db1926e-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-95a573e7-4224-4a16-937e-407ff4c8e322-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Lock "cinder-95a573e7-4224-4a16-937e-407ff4c8e322-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-95a573e7-4224-4a16-937e-407ff4c8e322" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-95a573e7-4224-4a16-937e-407ff4c8e322" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d80134f-d34b-4016-893e-b97da6047166]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 Sep 28 15:23:55 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:55 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322" returned: 0 in 0.414s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:55 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322 Sep 28 15:23:55 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-95a573e7-4224-4a16-937e-407ff4c8e322" returned: 0 in 0.250s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-95a573e7-4224-4a16-937e-407ff4c8e322" released by "delete_volume" :: held 0.713s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Created reservations ['f3027b21-ab69-42fd-bf70-06b2c7c0442a', '0b10a4dc-7645-44e7-9c4a-1692ae120e14', 'c24cef26-4842-488e-bfe7-793d83510ff4', 'c66ff16d-8c99-41d7-a5b5-d293b04c2679'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:56 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:56 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.297s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Deleted volume successfully. Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ee6821fb-9068-4384-822d-08b8ff8aea72 tempest-VolumesGetTest-1762514730 None] Lock "cinder-95a573e7-4224-4a16-937e-407ff4c8e322-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-40d36195-11d8-4a28-a4b1-bdb3f0972e94-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Lock "cinder-40d36195-11d8-4a28-a4b1-bdb3f0972e94-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-40d36195-11d8-4a28-a4b1-bdb3f0972e94" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-40d36195-11d8-4a28-a4b1-bdb3f0972e94" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[684cd4de-acbc-444c-b658-bf90b27d99bc]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:56 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 Sep 28 15:23:56 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94" returned: 0 in 0.389s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:57 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94 Sep 28 15:23:57 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-40d36195-11d8-4a28-a4b1-bdb3f0972e94" returned: 0 in 0.248s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-40d36195-11d8-4a28-a4b1-bdb3f0972e94" released by "delete_volume" :: held 0.709s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Created reservations ['ca36e793-3945-464a-bf97-db9111513d5d', '931c302c-c31c-4520-a71a-205f867c857d', '1b2c0b37-89f2-4dec-8bab-5bfffabe0ef0', '9f93020e-1cfe-42fc-b8d6-7e652b603c3f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:57 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:23:57 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:23:57 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.338s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:23:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Deleted volume successfully. Sep 28 15:23:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca2fe2bd-58c0-415e-aef7-3cb0d1fd0fbb tempest-VolumesGetTest-1762514730 None] Lock "cinder-40d36195-11d8-4a28-a4b1-bdb3f0972e94-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (94d5075b-8342-4388-ab33-dce4361f5f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a7eb08-5663-4452-bce7-27060d4c8e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a7eb08-5663-4452-bce7-27060d4c8e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-497658268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fa97d6-f694-4645-8387-315e6215317f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:59Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec51bb58-37a7-4f6b-88ee-6c71da04eafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec51bb58-37a7-4f6b-88ee-6c71da04eafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b43388-c0c9-41c1-86da-064778093c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:58 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b43388-c0c9-41c1-86da-064778093c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9fa97d6-f694-4645-8387-315e6215317f', 'volume_name': 'volume-c9fa97d6-f694-4645-8387-315e6215317f', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17297777-763a-4a5b-9d00-9c12d276fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17297777-763a-4a5b-9d00-9c12d276fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999f138b-a643-46d3-8b04-8b73607f8d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:23:59 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Volume c9fa97d6-f694-4645-8387-315e6215317f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9fa97d6-f694-4645-8387-315e6215317f', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Trying to clone c9fa97d6-f694-4645-8387-315e6215317f from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c at location (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:23:59 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Image download 20.69 MB at 20.69 MB/s Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81da1e-f9bc-4b60-8343-99731c0c5962]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:23:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:23:59 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD Sep 28 15:23:59 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c is fetched for user e16375ea9c904ae9be9700130cf530a4. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[50260aa9-c7c7-4da0-935e-25c304d9281a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD Sep 28 15:24:00 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-497658268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fa97d6-f694-4645-8387-315e6215317f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:23:59Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Creating volume c9fa97d6-f694-4645-8387-315e6215317f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:00 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f 1073741824 Sep 28 15:24:00 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:00 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f 1073741824" returned: 0 in 0.427s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:00 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f Sep 28 15:24:00 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f" returned: 0 in 0.249s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Attempting download of 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume c9fa97d6-f694-4645-8387-315e6215317f. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfcce05-7368-4a5c-a914-971372a9c4a8]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_qi9n12b9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:01 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_qi9n12b9 Sep 28 15:24:01 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_qi9n12b9" returned: 0 in 0.341s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_qi9n12b9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:01 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_qi9n12b9 Sep 28 15:24:01 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:01 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_qi9n12b9" returned: 1 in 0.381s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_qi9n12b9' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd254f0-aa9a-4e60-bc66-7c4405260ab6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:02 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD Sep 28 15:24:02 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:02 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:02 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c was qcow2, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:24:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:02 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f Sep 28 15:24:02 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f" returned: 0 in 1.930s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0c8860aa-e5f9-4d46-88ab-3c35d1976c9c_6deug12sdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:24:04 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Converted 112.00 MB image at 57.98 MB/s Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:04 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f 1G Sep 28 15:24:04 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:04 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f 1G" returned: 0 in 0.333s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Downloaded image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c ((None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}])) to volume c9fa97d6-f694-4645-8387-315e6215317f successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Temporary image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c for user e16375ea9c904ae9be9700130cf530a4 is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Marking volume c9fa97d6-f694-4645-8387-315e6215317f as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Copying metadata from image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c to c9fa97d6-f694-4645-8387-315e6215317f. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Creating volume glance metadata for volume c9fa97d6-f694-4645-8387-315e6215317f backed by image 0c8860aa-e5f9-4d46-88ab-3c35d1976c9c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999f138b-a643-46d3-8b04-8b73607f8d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9fa97d6-f694-4645-8387-315e6215317f', 'volume_size': 1, 'image_id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '51490d7a65754d1385227618e22eed0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0c8860aa-e5f9-4d46-88ab-3c35d1976c9c', 'created_at': datetime.datetime(2026, 9, 28, 12, 53, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 12, 53, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0c8860aa-e5f9-4d46-88ab-3c35d1976c9c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bcb564-3dbf-456f-a02b-412ed57bc755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:04 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Volume volume-c9fa97d6-f694-4645-8387-315e6215317f (c9fa97d6-f694-4645-8387-315e6215317f): created successfully Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bcb564-3dbf-456f-a02b-412ed57bc755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (94d5075b-8342-4388-ab33-dce4361f5f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2fb58423-f4f6-41bc-8fd3-de6026d89ecb tempest-VolumesGetTest-1762514730 None] Created volume successfully. Sep 28 15:24:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (fbc51f6c-cd45-49d3-a6d4-23c8d3037661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d85f488-3eb9-4d75-816b-e29b9592b3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d85f488-3eb9-4d75-816b-e29b9592b3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2138688154',display_name='tempest-VolumesGetTest-Volume-607505859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869b7cc3-bfb2-485b-b68a-a75a09051ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:06Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f04fb9-6bc7-4e98-9cb7-7ed3f7bbaaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f04fb9-6bc7-4e98-9cb7-7ed3f7bbaaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a064a71e-51ab-4642-a641-54ceba926976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a064a71e-51ab-4642-a641-54ceba926976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869b7cc3-bfb2-485b-b68a-a75a09051ae0', 'volume_name': 'volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc3f761-1f1a-4c80-967d-f3025dd82aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc3f761-1f1a-4c80-967d-f3025dd82aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d401ff3-3589-435c-b168-d4027c76d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:06 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Volume 869b7cc3-bfb2-485b-b68a-a75a09051ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0', 'volume_size': 1} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2138688154',display_name='tempest-VolumesGetTest-Volume-607505859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869b7cc3-bfb2-485b-b68a-a75a09051ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89c6523ce7e14d389f479774b7020774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:06Z,use_quota=True,user_id='e16375ea9c904ae9be9700130cf530a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Creating volume 869b7cc3-bfb2-485b-b68a-a75a09051ae0 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:06 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 1073741824 Sep 28 15:24:06 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 1073741824" returned: 0 in 0.437s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:06 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 Sep 28 15:24:06 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:06 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0" returned: 0 in 0.256s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d401ff3-3589-435c-b168-d4027c76d54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b4ebeb-c8ed-4b1a-adbd-97ad85798af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:06 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Volume volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 (869b7cc3-bfb2-485b-b68a-a75a09051ae0): created successfully Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58b4ebeb-c8ed-4b1a-adbd-97ad85798af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Flow 'volume_create_manager' (fbc51f6c-cd45-49d3-a6d4-23c8d3037661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-aa29ad44-653e-4734-818e-2db2aaebb1b4 tempest-VolumesGetTest-1762514730 None] Created volume successfully. Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-869b7cc3-bfb2-485b-b68a-a75a09051ae0-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Lock "cinder-869b7cc3-bfb2-485b-b68a-a75a09051ae0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-869b7cc3-bfb2-485b-b68a-a75a09051ae0" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-869b7cc3-bfb2-485b-b68a-a75a09051ae0" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f31134d-a0da-4d9f-8c0d-9208485b8985]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 Sep 28 15:24:07 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0" returned: 0 in 0.365s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0 Sep 28 15:24:07 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:07 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-869b7cc3-bfb2-485b-b68a-a75a09051ae0" returned: 0 in 0.263s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-869b7cc3-bfb2-485b-b68a-a75a09051ae0" released by "delete_volume" :: held 0.671s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Created reservations ['ca09c556-9cda-4932-9765-625aa61e164e', '4ee48254-a602-45d8-9b35-18cdcd10a0ec', '8e09ba0e-b408-4935-a7d0-4bbdb063eaa3', 'e3fe060c-30ae-44c4-9d18-c8c3195cfc50'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:07 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:07 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.263s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:08 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Deleted volume successfully. Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dc015bd-f494-4be1-9155-c324f8f90a9b tempest-VolumesGetTest-1762514730 None] Lock "cinder-869b7cc3-bfb2-485b-b68a-a75a09051ae0-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-c9fa97d6-f694-4645-8387-315e6215317f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Lock "cinder-c9fa97d6-f694-4645-8387-315e6215317f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Acquiring lock "cinder-quobyte-c9fa97d6-f694-4645-8387-315e6215317f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-c9fa97d6-f694-4645-8387-315e6215317f" acquired by "delete_volume" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7c59bf-8eda-412c-a8e8-bf286e2a04e8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:08 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f Sep 28 15:24:08 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:08 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f" returned: 0 in 0.366s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:08 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f Sep 28 15:24:08 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:09 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c9fa97d6-f694-4645-8387-315e6215317f" returned: 0 in 0.253s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Lock "cinder-quobyte-c9fa97d6-f694-4645-8387-315e6215317f" released by "delete_volume" :: held 0.665s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Created reservations ['183c08db-61b0-463d-8f57-e194d31c0ef8', 'ecdeaf2e-4e9c-4235-b59f-be6386e0b5ca', 'c5b7b3b4-1545-4061-a84f-a3ad6d04ba72', '505774ec-7f77-4381-8b1f-964b9a3d2107'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:09 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:09 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:09 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.282s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Deleted volume successfully. Sep 28 15:24:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1cd3bd66-d901-4ca5-bcf0-1817b0a55e79 tempest-VolumesGetTest-1762514730 None] Lock "cinder-c9fa97d6-f694-4645-8387-315e6215317f-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Flow 'volume_create_manager' (de4d9cee-8cac-4df6-a596-f72bd6abedf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af62c0c0-836b-47b8-8075-75987c2cdf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af62c0c0-836b-47b8-8075-75987c2cdf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946d218b-d649-4d7f-9966-efb9bd5e5284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96b8271f3cd4b3bbcc7bd2513df9e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:17Z,use_quota=True,user_id='6d297aee1850491d8098c80ade9e0dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01577973-2981-42ea-8cef-a0121b64bcb4),volume_type_id=01577973-2981-42ea-8cef-a0121b64bcb4)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d709cdc0-407b-4686-9cd3-dc84a56a7ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d709cdc0-407b-4686-9cd3-dc84a56a7ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c35822-1c43-48cd-82c3-66180d7f6923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:16 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c35822-1c43-48cd-82c3-66180d7f6923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '946d218b-d649-4d7f-9966-efb9bd5e5284', 'volume_name': 'volume-946d218b-d649-4d7f-9966-efb9bd5e5284', 'volume_size': 1, 'image_id': '3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd13686fe7d12dbdae45162d609310a91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b96b8271f3cd4b3bbcc7bd2513df9e10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6ebae1a948546bc331309e43fa4b191df9230c42bbe071c13ec55e7ab235363daff4caacab46ca54f5fb9a011296ef384aeb10f2a283bb50ad818b53360a811', 'id': '3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'created_at': datetime.datetime(2026, 9, 28, 13, 24, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df21292-9ad1-4553-9953-287e07c80e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df21292-9ad1-4553-9953-287e07c80e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaa21d3-ca41-493c-8413-908090a95624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:17 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Volume 946d218b-d649-4d7f-9966-efb9bd5e5284: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-946d218b-d649-4d7f-9966-efb9bd5e5284', 'volume_size': 1, 'image_id': '3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd13686fe7d12dbdae45162d609310a91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b96b8271f3cd4b3bbcc7bd2513df9e10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6ebae1a948546bc331309e43fa4b191df9230c42bbe071c13ec55e7ab235363daff4caacab46ca54f5fb9a011296ef384aeb10f2a283bb50ad818b53360a811', 'id': '3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'created_at': datetime.datetime(2026, 9, 28, 13, 24, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Trying to clone 946d218b-d649-4d7f-9966-efb9bd5e5284 from image 3c2561fb-8918-4b38-b7d5-2a581baf32ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:24:17 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a0d8d8-9328-4071-8768-7c59ba3b39d8]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:17 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD Sep 28 15:24:17 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:17 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:17 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD Sep 28 15:24:17 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:18 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Temporary image 3c2561fb-8918-4b38-b7d5-2a581baf32ff is fetched for user 6d297aee1850491d8098c80ade9e0dfd. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fbbb4-788f-43d9-a175-08d38edda3f3]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:18 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD Sep 28 15:24:18 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:18 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:18 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD Sep 28 15:24:18 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:18 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946d218b-d649-4d7f-9966-efb9bd5e5284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b96b8271f3cd4b3bbcc7bd2513df9e10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:17Z,use_quota=True,user_id='6d297aee1850491d8098c80ade9e0dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01577973-2981-42ea-8cef-a0121b64bcb4),volume_type_id=01577973-2981-42ea-8cef-a0121b64bcb4)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Creating volume 946d218b-d649-4d7f-9966-efb9bd5e5284 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:18 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:18 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 1073741824 Sep 28 15:24:18 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:19 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 1073741824" returned: 0 in 0.529s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:19 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 Sep 28 15:24:19 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:19 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284" returned: 0 in 0.336s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Attempting download of 3c2561fb-8918-4b38-b7d5-2a581baf32ff ((None, [{'url': 'file:///opt/stack/data/glance/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'metadata': {}}])) to volume 946d218b-d649-4d7f-9966-efb9bd5e5284. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15f911b-a0c9-455a-9a19-4973857db865]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c2561fb-8918-4b38-b7d5-2a581baf32ff_qadgzqqe {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:20 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c2561fb-8918-4b38-b7d5-2a581baf32ff_qadgzqqe Sep 28 15:24:20 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:20 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3c2561fb-8918-4b38-b7d5-2a581baf32ff_qadgzqqe" returned: 0 in 0.386s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c2561fb-8918-4b38-b7d5-2a581baf32ff_qadgzqqe {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:20 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c2561fb-8918-4b38-b7d5-2a581baf32ff_qadgzqqe Sep 28 15:24:20 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:20 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c2561fb-8918-4b38-b7d5-2a581baf32ff_qadgzqqe" returned: 1 in 0.393s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3c2561fb-8918-4b38-b7d5-2a581baf32ff_qadgzqqe' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:24:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5118d5b4-a409-4f03-bf65-8d7e08c1f0db]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:20 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD Sep 28 15:24:20 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:21 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:21 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD Sep 28 15:24:21 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:21 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:24:21 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] 3c2561fb-8918-4b38-b7d5-2a581baf32ff was raw, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:24:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:21 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 Sep 28 15:24:21 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:22 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284" returned: 0 in 0.595s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c2561fb-8918-4b38-b7d5-2a581baf32ff_7pmus0uydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:24:22 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:22 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 1G Sep 28 15:24:22 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:22 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 1G" returned: 0 in 0.391s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Downloaded image 3c2561fb-8918-4b38-b7d5-2a581baf32ff ((None, [{'url': 'file:///opt/stack/data/glance/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'metadata': {}}])) to volume 946d218b-d649-4d7f-9966-efb9bd5e5284 successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Temporary image 3c2561fb-8918-4b38-b7d5-2a581baf32ff for user 6d297aee1850491d8098c80ade9e0dfd is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Marking volume 946d218b-d649-4d7f-9966-efb9bd5e5284 as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=61,cinder:INSERT=27,cinder:UPDATE=90,cinder:DELETE=7 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Copying metadata from image 3c2561fb-8918-4b38-b7d5-2a581baf32ff to 946d218b-d649-4d7f-9966-efb9bd5e5284. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Creating volume glance metadata for volume 946d218b-d649-4d7f-9966-efb9bd5e5284 backed by image 3c2561fb-8918-4b38-b7d5-2a581baf32ff with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd13686fe7d12dbdae45162d609310a91', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=74,cinder:INSERT=29,cinder:UPDATE=91,cinder:DELETE=8 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aaa21d3-ca41-493c-8413-908090a95624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946d218b-d649-4d7f-9966-efb9bd5e5284', 'volume_size': 1, 'image_id': '3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd13686fe7d12dbdae45162d609310a91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b96b8271f3cd4b3bbcc7bd2513df9e10', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e6ebae1a948546bc331309e43fa4b191df9230c42bbe071c13ec55e7ab235363daff4caacab46ca54f5fb9a011296ef384aeb10f2a283bb50ad818b53360a811', 'id': '3c2561fb-8918-4b38-b7d5-2a581baf32ff', 'created_at': datetime.datetime(2026, 9, 28, 13, 24, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c2561fb-8918-4b38-b7d5-2a581baf32ff/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36446962-6574-4351-a5db-cc51021fc913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:22 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Volume volume-946d218b-d649-4d7f-9966-efb9bd5e5284 (946d218b-d649-4d7f-9966-efb9bd5e5284): created successfully Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36446962-6574-4351-a5db-cc51021fc913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Flow 'volume_create_manager' (de4d9cee-8cac-4df6-a596-f72bd6abedf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-19e64187-8732-4100-aaaa-8148cd869693 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Created volume successfully. Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Acquiring lock "cinder-946d218b-d649-4d7f-9966-efb9bd5e5284-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "cinder-946d218b-d649-4d7f-9966-efb9bd5e5284-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Acquiring lock "cinder-quobyte-946d218b-d649-4d7f-9966-efb9bd5e5284" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "cinder-quobyte-946d218b-d649-4d7f-9966-efb9bd5e5284" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbae9f4-9d93-454e-81e1-d80fc751dafa]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:23 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 Sep 28 15:24:23 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:23 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284" returned: 0 in 0.442s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:23 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284 Sep 28 15:24:23 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:24 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-946d218b-d649-4d7f-9966-efb9bd5e5284" returned: 0 in 0.315s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "cinder-quobyte-946d218b-d649-4d7f-9966-efb9bd5e5284" released by "delete_volume" :: held 0.807s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:24 devstack cinder-volume[86301]: WARNING cinder.quota [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:24:24 devstack cinder-volume[86301]: WARNING cinder.quota [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Created reservations ['d0039883-5100-4d68-b2cb-0ece4d842d4e', '54f75af1-e5ab-4745-8bd5-f713a180ded1', 'c766b71c-05ce-406d-80f8-c5e459915687', '943b6190-e2b0-429f-9513-7b0b2c0215b0'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:24 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:24 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:24 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.356s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Deleted volume successfully. Sep 28 15:24:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-87dbd45d-83e2-42e8-96ea-3d65c1075469 tempest-VolumeAndVolumeTypeFromImageTest-1294836072 None] Lock "cinder-946d218b-d649-4d7f-9966-efb9bd5e5284-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (cee6104c-87c6-4b17-84a5-516c83d6b80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0732e1-23e6-4c48-8b3f-acef36f8a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0732e1-23e6-4c48-8b3f-acef36f8a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126938023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3cd610-41c9-40ed-af9e-ef9453245690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:30Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fb4288-e18a-4720-9532-16e1b79c7544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36fb4288-e18a-4720-9532-16e1b79c7544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3396694d-d908-46db-9a02-de798d2ea101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3396694d-d908-46db-9a02-de798d2ea101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3cd610-41c9-40ed-af9e-ef9453245690', 'volume_name': 'volume-6b3cd610-41c9-40ed-af9e-ef9453245690', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2b747f-a2df-4542-81ca-1d2d911ab81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2b747f-a2df-4542-81ca-1d2d911ab81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f0cdec-0f3f-4e6c-8527-34a703f0c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:29 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume 6b3cd610-41c9-40ed-af9e-ef9453245690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3cd610-41c9-40ed-af9e-ef9453245690', 'volume_size': 1} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126938023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3cd610-41c9-40ed-af9e-ef9453245690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:30Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Creating volume 6b3cd610-41c9-40ed-af9e-ef9453245690 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:29 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:29 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 1073741824 Sep 28 15:24:29 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 1073741824" returned: 0 in 0.440s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:30 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 Sep 28 15:24:30 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:30 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690" returned: 0 in 0.271s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f0cdec-0f3f-4e6c-8527-34a703f0c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3cd610-41c9-40ed-af9e-ef9453245690', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086cd516-9288-46c0-ab1c-1095c88658e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume volume-6b3cd610-41c9-40ed-af9e-ef9453245690 (6b3cd610-41c9-40ed-af9e-ef9453245690): created successfully Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086cd516-9288-46c0-ab1c-1095c88658e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (cee6104c-87c6-4b17-84a5-516c83d6b80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e20bdc70-909d-461e-9d4b-3632195ec360 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created volume successfully. Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (94d0b8d1-8496-4876-b020-4c3969427d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d659ae-2f91-495a-8269-c12a6ff7897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d659ae-2f91-495a-8269-c12a6ff7897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52203798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a49cf66-808e-414f-aaac-d1f87c0a3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:32Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f0658-e706-4f3a-9fdf-9204ad70191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f0658-e706-4f3a-9fdf-9204ad70191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce093e-3731-48ae-8714-fe00b02f2dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cce093e-3731-48ae-8714-fe00b02f2dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a49cf66-808e-414f-aaac-d1f87c0a3fd6', 'volume_name': 'volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1358eb4e-6541-451b-87e2-9be85381d919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1358eb4e-6541-451b-87e2-9be85381d919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb2addd-3e45-4616-95c1-e38c6227fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume 3a49cf66-808e-414f-aaac-d1f87c0a3fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6', 'volume_size': 1} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52203798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a49cf66-808e-414f-aaac-d1f87c0a3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:32Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Creating volume 3a49cf66-808e-414f-aaac-d1f87c0a3fd6 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:32 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:32 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 1073741824 Sep 28 15:24:32 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (389eb48f-cd84-4c68-880e-39851296ba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a56b97d-b1f5-4b1d-ad7a-e95666e51bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a56b97d-b1f5-4b1d-ad7a-e95666e51bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1858847136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252bfe57-15f3-47be-befe-fce8b0ad4d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:33Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c1b292-4119-4413-8fd7-67ab5549aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c1b292-4119-4413-8fd7-67ab5549aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9784cfec-0827-4189-afe1-bc2fa936f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9784cfec-0827-4189-afe1-bc2fa936f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252bfe57-15f3-47be-befe-fce8b0ad4d48', 'volume_name': 'volume-252bfe57-15f3-47be-befe-fce8b0ad4d48', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0093efc-7e66-4dc6-93da-6bf464b04093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0093efc-7e66-4dc6-93da-6bf464b04093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac00f9d1-f550-47e5-94dc-494d45d44e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume 252bfe57-15f3-47be-befe-fce8b0ad4d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252bfe57-15f3-47be-befe-fce8b0ad4d48', 'volume_size': 1} Sep 28 15:24:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:33 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 1073741824" returned: 0 in 0.620s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:33 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 Sep 28 15:24:33 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (6019656a-8351-4ce2-8f39-6afac81fe486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf697c9-4061-4063-8708-5c1d4acd8725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf697c9-4061-4063-8708-5c1d4acd8725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679816350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4efd70-dc58-4fe6-bf61-098d527db535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:33Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42234b82-f1d4-4bf1-b556-3302efe80bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42234b82-f1d4-4bf1-b556-3302efe80bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77879583-51f4-48af-94d5-af488a4adb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77879583-51f4-48af-94d5-af488a4adb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4efd70-dc58-4fe6-bf61-098d527db535', 'volume_name': 'volume-4a4efd70-dc58-4fe6-bf61-098d527db535', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2867a00-89ba-443c-82df-7cc5b66e1f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2867a00-89ba-443c-82df-7cc5b66e1f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4eb772-9b19-4114-ba43-9d1ca119462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume 4a4efd70-dc58-4fe6-bf61-098d527db535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4efd70-dc58-4fe6-bf61-098d527db535', 'volume_size': 1} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:33 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6" returned: 0 in 0.345s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1858847136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252bfe57-15f3-47be-befe-fce8b0ad4d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:33Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Creating volume 252bfe57-15f3-47be-befe-fce8b0ad4d48 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:33 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb2addd-3e45-4616-95c1-e38c6227fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 1073741824 Sep 28 15:24:33 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd0c954-e0d9-4c12-9b99-a6de3e7623ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 (3a49cf66-808e-414f-aaac-d1f87c0a3fd6): created successfully Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd0c954-e0d9-4c12-9b99-a6de3e7623ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (94d0b8d1-8496-4876-b020-4c3969427d79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-be89ac22-d02e-4a0e-bc9d-a5070724aed3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created volume successfully. Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (6776b6bb-3c70-4385-8860-31499249132b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63897a17-e58c-4c99-a8ba-bf32ac7a77e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63897a17-e58c-4c99-a8ba-bf32ac7a77e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935096007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ace792-e33f-4e9c-a41b-ae2a6d9226be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:34Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e437827a-b423-446f-ad08-de870c98fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e437827a-b423-446f-ad08-de870c98fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a239e3-531f-496a-887f-247b43103575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a239e3-531f-496a-887f-247b43103575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ace792-e33f-4e9c-a41b-ae2a6d9226be', 'volume_name': 'volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b1593f-6571-4246-b59a-9d177483c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b1593f-6571-4246-b59a-9d177483c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a6f7fe-baa0-4439-910d-bc08b9bb8ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:33 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume b9ace792-e33f-4e9c-a41b-ae2a6d9226be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be', 'volume_size': 1} Sep 28 15:24:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:34 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 1073741824" returned: 0 in 0.598s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (75f740fa-6872-4db4-9c1f-ca3f4aa96749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e68a3d8-fda6-4fe6-bbda-e60299c44ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e68a3d8-fda6-4fe6-bbda-e60299c44ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519874062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442ab1bb-ac06-457a-9d6c-51e6d4f200ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:34Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc586477-f62c-4870-8a2e-bebdbe9acf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc586477-f62c-4870-8a2e-bebdbe9acf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447be5b4-1a75-4f9e-a685-c0f0230810c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447be5b4-1a75-4f9e-a685-c0f0230810c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '442ab1bb-ac06-457a-9d6c-51e6d4f200ad', 'volume_name': 'volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85610365-1b71-4f02-a5e5-08ac50006140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85610365-1b71-4f02-a5e5-08ac50006140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d45aa5-8bb4-4a62-93eb-64d7656a5218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:34 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume 442ab1bb-ac06-457a-9d6c-51e6d4f200ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad', 'volume_size': 1} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:34 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 Sep 28 15:24:34 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:34 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48" returned: 0 in 0.273s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1679816350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4efd70-dc58-4fe6-bf61-098d527db535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:33Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Creating volume 4a4efd70-dc58-4fe6-bf61-098d527db535 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:34 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:34 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 1073741824 Sep 28 15:24:34 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac00f9d1-f550-47e5-94dc-494d45d44e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252bfe57-15f3-47be-befe-fce8b0ad4d48', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481e3ebd-adda-470c-9894-0e26f965eb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:34 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 (252bfe57-15f3-47be-befe-fce8b0ad4d48): created successfully Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481e3ebd-adda-470c-9894-0e26f965eb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (389eb48f-cd84-4c68-880e-39851296ba62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-007b108b-1e56-4c60-9cef-814701536213 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created volume successfully. Sep 28 15:24:34 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 1073741824" returned: 0 in 0.470s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:35 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 Sep 28 15:24:35 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:35 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535" returned: 0 in 0.279s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935096007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ace792-e33f-4e9c-a41b-ae2a6d9226be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:34Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Creating volume b9ace792-e33f-4e9c-a41b-ae2a6d9226be {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:35 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4eb772-9b19-4114-ba43-9d1ca119462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4efd70-dc58-4fe6-bf61-098d527db535', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a2287b-496b-435d-9ce9-da1c6bf12334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:35 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be 1073741824 Sep 28 15:24:35 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:35 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume volume-4a4efd70-dc58-4fe6-bf61-098d527db535 (4a4efd70-dc58-4fe6-bf61-098d527db535): created successfully Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a2287b-496b-435d-9ce9-da1c6bf12334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (6019656a-8351-4ce2-8f39-6afac81fe486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e76cbad4-420a-4174-81b4-22d3ce3cd11f tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created volume successfully. Sep 28 15:24:35 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be 1073741824" returned: 0 in 0.604s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:35 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be Sep 28 15:24:35 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:36 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be" returned: 0 in 0.254s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519874062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442ab1bb-ac06-457a-9d6c-51e6d4f200ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6196336e7f64dcab890e967a468c0b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:34Z,use_quota=True,user_id='5e2de0f718914d7ba2b307bf3b2e39a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Creating volume 442ab1bb-ac06-457a-9d6c-51e6d4f200ad {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:36 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a6f7fe-baa0-4439-910d-bc08b9bb8ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:36 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad 1073741824 Sep 28 15:24:36 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415fc57a-12db-4ab0-b1d5-724899c6bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:36 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be (b9ace792-e33f-4e9c-a41b-ae2a6d9226be): created successfully Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (415fc57a-12db-4ab0-b1d5-724899c6bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (6776b6bb-3c70-4385-8860-31499249132b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-84d39b8a-5bc0-476e-86f4-941b40df43c1 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created volume successfully. Sep 28 15:24:36 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad 1073741824" returned: 0 in 0.470s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:36 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad Sep 28 15:24:36 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:37 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d45aa5-8bb4-4a62-93eb-64d7656a5218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7bd916-2d76-4d64-aa21-c6ed8ca1a5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:37 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Volume volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad (442ab1bb-ac06-457a-9d6c-51e6d4f200ad): created successfully Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7bd916-2d76-4d64-aa21-c6ed8ca1a5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Flow 'volume_create_manager' (75f740fa-6872-4db4-9c1f-ca3f4aa96749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f8b4d00d-c10c-423f-bcca-85a49fbdd7f9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created volume successfully. Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-442ab1bb-ac06-457a-9d6c-51e6d4f200ad-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-442ab1bb-ac06-457a-9d6c-51e6d4f200ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-quobyte-442ab1bb-ac06-457a-9d6c-51e6d4f200ad" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-442ab1bb-ac06-457a-9d6c-51e6d4f200ad" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3ba647-ef3f-4791-8074-57595bb13fa2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:37 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad Sep 28 15:24:37 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:38 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad" returned: 0 in 0.422s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:38 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad Sep 28 15:24:38 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:38 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-442ab1bb-ac06-457a-9d6c-51e6d4f200ad" returned: 0 in 0.311s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-442ab1bb-ac06-457a-9d6c-51e6d4f200ad" released by "delete_volume" :: held 0.780s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created reservations ['6e529d1b-5200-4f96-9d71-f043da1744e4', '18487fe2-6755-46ab-8ba4-085fc50ef27d', '9bceb592-2730-4045-b4df-88d3d2cab6ac', '11bd21c7-4926-41c2-b9ed-2653ca0a7726'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:38 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:38 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-b9ace792-e33f-4e9c-a41b-ae2a6d9226be-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-b9ace792-e33f-4e9c-a41b-ae2a6d9226be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:38 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.290s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-quobyte-b9ace792-e33f-4e9c-a41b-ae2a6d9226be" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Deleted volume successfully. Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-b9ace792-e33f-4e9c-a41b-ae2a6d9226be" acquired by "delete_volume" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01ae30a2-a44b-48f2-8816-13c0e2dfc6e3 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-442ab1bb-ac06-457a-9d6c-51e6d4f200ad-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f248b5f-1ce4-46a0-8de1-a82d58a20aed]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:39 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be Sep 28 15:24:39 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:39 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be" returned: 0 in 0.426s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:39 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be Sep 28 15:24:39 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:39 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b9ace792-e33f-4e9c-a41b-ae2a6d9226be" returned: 0 in 0.271s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-b9ace792-e33f-4e9c-a41b-ae2a6d9226be" released by "delete_volume" :: held 0.751s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created reservations ['8ed0fa46-b142-47cc-b480-c348310d63a1', '03b8f8e3-c221-4edc-adc7-726f93ed8dea', 'd191cf64-6392-409f-934d-772ba81ba976', 'aad5b914-6abb-443e-8bad-22adef47d478'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:39 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:39 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-4a4efd70-dc58-4fe6-bf61-098d527db535-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-4a4efd70-dc58-4fe6-bf61-098d527db535-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-quobyte-4a4efd70-dc58-4fe6-bf61-098d527db535" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-4a4efd70-dc58-4fe6-bf61-098d527db535" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:40 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.280s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:40 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Deleted volume successfully. Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d92045-1e9c-4bff-ad9b-c62eadec8607]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-7e11988e-c4a2-4f5b-9049-5554ad193acb tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-b9ace792-e33f-4e9c-a41b-ae2a6d9226be-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:40 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 Sep 28 15:24:40 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535" returned: 0 in 0.398s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535 Sep 28 15:24:40 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:40 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4a4efd70-dc58-4fe6-bf61-098d527db535" returned: 0 in 0.291s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-4a4efd70-dc58-4fe6-bf61-098d527db535" released by "delete_volume" :: held 0.747s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created reservations ['66711b4b-2fb3-47f5-94a8-76cc239051d4', 'f0a81f3f-0b74-4ba4-8b00-a7395b1eb13a', '055f2d41-cd78-4f01-ad18-7c9992459a56', '8df857b5-204c-4d87-b44c-64b2ea44c7ec'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:40 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:40 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-252bfe57-15f3-47be-befe-fce8b0ad4d48-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-252bfe57-15f3-47be-befe-fce8b0ad4d48-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-quobyte-252bfe57-15f3-47be-befe-fce8b0ad4d48" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:41 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.285s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-252bfe57-15f3-47be-befe-fce8b0ad4d48" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Deleted volume successfully. Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-fe93675b-6cec-468d-bc10-5cee26c44c6a tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-4a4efd70-dc58-4fe6-bf61-098d527db535-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e044794-aec8-4a18-af90-cabf6647276e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 Sep 28 15:24:41 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:41 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:41 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48 Sep 28 15:24:41 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:41 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-252bfe57-15f3-47be-befe-fce8b0ad4d48" returned: 0 in 0.243s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-252bfe57-15f3-47be-befe-fce8b0ad4d48" released by "delete_volume" :: held 0.681s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:41 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created reservations ['9639f0da-d69e-49c6-a0ed-4ec16c870a24', 'a5078e71-eb84-41a4-9a27-c480b300906e', '3a7a1cf5-536a-44bd-b57f-b983b593f280', '81e97103-c71f-4cf3-9a4a-94400209901a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:42 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:42 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Deleted volume successfully. Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e2acc0-2641-474f-9f7f-7a460a5f7bec tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-252bfe57-15f3-47be-befe-fce8b0ad4d48-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-3a49cf66-808e-414f-aaac-d1f87c0a3fd6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-3a49cf66-808e-414f-aaac-d1f87c0a3fd6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-quobyte-3a49cf66-808e-414f-aaac-d1f87c0a3fd6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-3a49cf66-808e-414f-aaac-d1f87c0a3fd6" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce4a77-e3a2-4d3e-ac49-9fac837390b2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 Sep 28 15:24:42 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:42 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:42 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6 Sep 28 15:24:42 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-3a49cf66-808e-414f-aaac-d1f87c0a3fd6" returned: 0 in 0.249s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-3a49cf66-808e-414f-aaac-d1f87c0a3fd6" released by "delete_volume" :: held 0.696s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created reservations ['7a10e67c-9456-42a5-b836-00bcf6abb3b4', 'cd13f223-abf8-4fba-91de-fc2c44cfc2a5', 'ead7cbe5-7367-4601-ae88-afbdf37a94ec', '56fba6b0-1bd6-41e4-96c4-aee79e7b0bc7'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:43 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:43 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:43 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.254s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Deleted volume successfully. Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-bb7779bc-8a94-4cd8-aacf-d72861b8fa27 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-3a49cf66-808e-414f-aaac-d1f87c0a3fd6-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-6b3cd610-41c9-40ed-af9e-ef9453245690-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-6b3cd610-41c9-40ed-af9e-ef9453245690-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "cinder-quobyte-6b3cd610-41c9-40ed-af9e-ef9453245690" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-6b3cd610-41c9-40ed-af9e-ef9453245690" acquired by "delete_volume" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c48f2-ba4d-48c3-9f60-627682a95746]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:43 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 Sep 28 15:24:43 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:44 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690" returned: 0 in 0.375s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:44 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690 Sep 28 15:24:44 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:44 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b3cd610-41c9-40ed-af9e-ef9453245690" returned: 0 in 0.238s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-quobyte-6b3cd610-41c9-40ed-af9e-ef9453245690" released by "delete_volume" :: held 0.651s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Created reservations ['c7619e49-7df9-4468-b64b-7b1d6508a9d6', 'd7c3fa6a-9705-40b5-b655-8312dff38209', '444844bb-163e-4fab-895b-5898ad0fbce9', '2c6e4fbe-9079-4862-9b3e-122d23afd10a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:44 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:44 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:44 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.249s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Deleted volume successfully. Sep 28 15:24:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d61b300e-1070-425a-9216-1f0fec54d1c9 tempest-CreateVolumesFromSourceVolumeTest-2103286445 None] Lock "cinder-6b3cd610-41c9-40ed-af9e-ef9453245690-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:47 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:24:47 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:47 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.282s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Flow 'volume_create_manager' (04731666-28bb-4377-bdf5-2e32191e92ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6fc799-82f5-4f53-9c27-01fd0efa7cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6fc799-82f5-4f53-9c27-01fd0efa7cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772225714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bd0ab7-b5b9-452f-8b55-574f7ffa0038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ff7e20980d4c3182bc98e853340822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:48Z,use_quota=True,user_id='e8f0e44a86c94f2ba284ca5c4b245a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0fca3b-7340-4c76-99a9-bdc2660bc103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a0fca3b-7340-4c76-99a9-bdc2660bc103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ceed1-5ea1-4e69-96ff-2151dc74ee82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347ceed1-5ea1-4e69-96ff-2151dc74ee82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bd0ab7-b5b9-452f-8b55-574f7ffa0038', 'volume_name': 'volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d1c3b6-de87-4165-a418-a5772ae9acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d1c3b6-de87-4165-a418-a5772ae9acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a82ee3c-9b15-4c1e-a408-086d15aa91a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:47 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Volume f2bd0ab7-b5b9-452f-8b55-574f7ffa0038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038', 'volume_size': 1} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-772225714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2bd0ab7-b5b9-452f-8b55-574f7ffa0038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ff7e20980d4c3182bc98e853340822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:48Z,use_quota=True,user_id='e8f0e44a86c94f2ba284ca5c4b245a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Creating volume f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:47 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:24:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:47 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 1073741824 Sep 28 15:24:47 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:48 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 1073741824" returned: 0 in 0.528s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:48 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 Sep 28 15:24:48 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:48 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" returned: 0 in 0.299s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a82ee3c-9b15-4c1e-a408-086d15aa91a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7aa3f4-ab58-401a-8aec-35094c27cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:48 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Volume volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 (f2bd0ab7-b5b9-452f-8b55-574f7ffa0038): created successfully Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7aa3f4-ab58-401a-8aec-35094c27cac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Flow 'volume_create_manager' (04731666-28bb-4377-bdf5-2e32191e92ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:48 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-08158e23-0c11-408f-8db9-b96a41df5254 tempest-VolumeDependencyTests-1447152126 None] Created volume successfully. Sep 28 15:24:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Creating offline snapshot 0775c5a4-596f-490a-b393-b52edd4039cc of volume f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:24:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba1430-5cb1-4484-ba78-c6e22982a85a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:50 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 Sep 28 15:24:50 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:50 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" returned: 0 in 0.438s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:50 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc 1G Sep 28 15:24:50 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc 1G" returned: 0 in 0.473s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc Sep 28 15:24:51 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc" returned: 0 in 0.305s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc is being set with open permissions: ugo+rw Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc Sep 28 15:24:51 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc" returned: 0 in 0.260s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:51 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.info Sep 28 15:24:51 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:51 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.info" returned: 0 in 0.265s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:51 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.info is being set with open permissions: ugo+rw Sep 28 15:24:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:52 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.info Sep 28 15:24:52 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:52 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.info" returned: 0 in 0.258s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a3a1248c-c156-4e09-9008-bc7a548f9044 tempest-VolumeDependencyTests-1447152126 None] Create snapshot completed successfully Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Flow 'volume_create_manager' (86abc2cf-cdc5-44d3-96a0-0b4e6bc740ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e191756-3a7f-4047-b340-51618388960e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e191756-3a7f-4047-b340-51618388960e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1580669461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bdd52e-21c9-4eac-89e0-7a1714a3602f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ff7e20980d4c3182bc98e853340822',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0775c5a4-596f-490a-b393-b52edd4039cc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:24:54Z,use_quota=True,user_id='e8f0e44a86c94f2ba284ca5c4b245a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3dfc2f-73bf-4e93-a298-aa216df5d6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3dfc2f-73bf-4e93-a298-aa216df5d6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2a3fc7-270c-4d1e-89b9-1358fa0226c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2a3fc7-270c-4d1e-89b9-1358fa0226c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3bdd52e-21c9-4eac-89e0-7a1714a3602f', 'volume_name': 'volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f', 'volume_size': 1, 'snapshot_id': '0775c5a4-596f-490a-b393-b52edd4039cc'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84034e5-76f5-4a6f-9fc3-a76d894d565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84034e5-76f5-4a6f-9fc3-a76d894d565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:24:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379e8b54-f73c-46fb-8eab-f3f329396cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:24:54 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Volume a3bdd52e-21c9-4eac-89e0-7a1714a3602f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f', 'volume_size': 1, 'snapshot_id': '0775c5a4-596f-490a-b393-b52edd4039cc'} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-quobyte-0775c5a4-596f-490a-b393-b52edd4039cc-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-0775c5a4-596f-490a-b393-b52edd4039cc-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Creating volume a3bdd52e-21c9-4eac-89e0-7a1714a3602f from snapshot 0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-quobyte-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] snapshot: 0775c5a4-596f-490a-b393-b52edd4039cc, volume: a3bdd52e-21c9-4eac-89e0-7a1714a3602f, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e959ab94-8219-41bc-89f9-f0583dc9d57d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc Sep 28 15:24:54 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc" returned: 0 in 0.400s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[79601544-0859-4981-b34c-a37f8d869d43]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 Sep 28 15:24:54 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:24:54 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" returned: 0 in 0.420s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:24:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:24:54 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f Sep 28 15:24:54 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:01 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" returned: 0 in 6.644s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:25:01 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Converted 1024.00 MB image at 154.09 MB/s Sep 28 15:25:01 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f is being set with open permissions: ugo+rw Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:01 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f Sep 28 15:25:01 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:01 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" returned: 0 in 0.268s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" released by "_copy_volume_from_snapshot" :: held 7.820s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-0775c5a4-596f-490a-b393-b52edd4039cc-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" released by "_create_volume_from_snapshot" :: held 7.906s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.924s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379e8b54-f73c-46fb-8eab-f3f329396cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f', 'volume_size': 1, 'snapshot_id': '0775c5a4-596f-490a-b393-b52edd4039cc'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39358d73-d9d0-46af-a9c5-fe526e207a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:01 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Volume volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f (a3bdd52e-21c9-4eac-89e0-7a1714a3602f): created successfully Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39358d73-d9d0-46af-a9c5-fe526e207a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Flow 'volume_create_manager' (86abc2cf-cdc5-44d3-96a0-0b4e6bc740ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-196fd7be-27e1-46d3-b616-356e533674d5 tempest-VolumeDependencyTests-1447152126 None] Created volume successfully. Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-0775c5a4-596f-490a-b393-b52edd4039cc-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-0775c5a4-596f-490a-b393-b52edd4039cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-quobyte-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-quobyte-0775c5a4-596f-490a-b393-b52edd4039cc" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-0775c5a4-596f-490a-b393-b52edd4039cc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Deleting offline snapshot 0775c5a4-596f-490a-b393-b52edd4039cc of volume f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] snapshot_file for this snap is: volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[effb73e8-0cbd-48b1-b376-6c0ce6b1aae5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:02 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc Sep 28 15:25:02 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:03 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc" returned: 0 in 0.383s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:25:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69fc4a-3a4f-43c2-b3f6-4cda2a38f3b7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:03 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 Sep 28 15:25:03 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:03 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" returned: 0 in 0.570s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:03 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc Sep 28 15:25:03 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:04 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc" returned: 0 in 0.385s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:04 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc Sep 28 15:25:04 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:04 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038.0775c5a4-596f-490a-b393-b52edd4039cc" returned: 0 in 0.264s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-0775c5a4-596f-490a-b393-b52edd4039cc" released by "_delete_snapshot" :: held 1.719s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" released by "delete_snapshot" :: held 1.743s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Created reservations ['8e34518b-194b-47f1-828e-b301220c950c', '62783806-dc68-4109-bd46-5be840502a53', '56c76754-421e-4994-89bd-db1ffd831b0f', '9885ad7c-3bc3-44c0-a54b-12020ac25032'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Delete snapshot completed successfully. Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b10c2d06-a49e-4e12-bed4-e8d8a2159430 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-0775c5a4-596f-490a-b393-b52edd4039cc-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-quobyte-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfcdc5a-b557-42fa-99a5-dd76cf2f99d7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:05 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 Sep 28 15:25:05 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:05 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" returned: 0 in 0.364s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:05 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038 Sep 28 15:25:05 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:05 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" returned: 0 in 0.268s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038" released by "delete_volume" :: held 0.701s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Created reservations ['0a058d7f-2170-43c2-ae6a-3c12cdfa9135', '3bb09d7c-b8df-4536-9233-ccb3d193c27d', 'a041bee7-29b6-4159-aeba-94b692cd3ead', '6de49661-125c-470f-9b74-2f8c0adc97ed'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:05 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:05 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:06 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.296s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:06 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Deleted volume successfully. Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-a3bdd52e-21c9-4eac-89e0-7a1714a3602f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8336148c-436d-4970-ae89-2c4ed04a1dd7 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-f2bd0ab7-b5b9-452f-8b55-574f7ffa0038-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-a3bdd52e-21c9-4eac-89e0-7a1714a3602f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "cinder-quobyte-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec402006-8470-4241-8ab2-4b3cc8f62cf2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:06 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f Sep 28 15:25:06 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:06 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" returned: 0 in 0.399s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:06 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f Sep 28 15:25:06 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:06 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" returned: 0 in 0.324s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-quobyte-a3bdd52e-21c9-4eac-89e0-7a1714a3602f" released by "delete_volume" :: held 0.769s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:06 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Created reservations ['b0e71376-2361-484e-9fc1-e1633cabe1e8', 'c3c22be0-c489-4c3a-a2db-31c04582c284', 'b13d8548-adc2-4529-89e0-0cfbc6a96266', 'd45e651e-4d9e-4d7a-bb2e-fd519925bbcd'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:07 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:07 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:07 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.245s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:07 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Deleted volume successfully. Sep 28 15:25:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6f625cb9-93af-4c3c-8ca7-5ca2c97b7fe2 tempest-VolumeDependencyTests-1447152126 None] Lock "cinder-a3bdd52e-21c9-4eac-89e0-7a1714a3602f-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Flow 'volume_create_manager' (e3d7a993-dc90-4362-9efe-79d4f5f3de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55efa523-89e6-4e88-affa-ee9e2caf5f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55efa523-89e6-4e88-affa-ee9e2caf5f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728574347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28af3e6a-e849-455c-a2e4-0f098783fe32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e7ea4941343fa95c2c4268be6fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:11Z,use_quota=True,user_id='63bf3a1c20ec471589407c98e685cf23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e34da28-70b7-4888-b536-91688d96d868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e34da28-70b7-4888-b536-91688d96d868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6bd737-32b7-473c-951b-1c5eba65cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6bd737-32b7-473c-951b-1c5eba65cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28af3e6a-e849-455c-a2e4-0f098783fe32', 'volume_name': 'volume-28af3e6a-e849-455c-a2e4-0f098783fe32', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66760c3e-766e-4282-b051-db12dddef7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66760c3e-766e-4282-b051-db12dddef7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7356d120-ac88-425a-af35-1065617a3590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:11 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Volume 28af3e6a-e849-455c-a2e4-0f098783fe32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28af3e6a-e849-455c-a2e4-0f098783fe32', 'volume_size': 1} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-728574347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28af3e6a-e849-455c-a2e4-0f098783fe32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e7ea4941343fa95c2c4268be6fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:11Z,use_quota=True,user_id='63bf3a1c20ec471589407c98e685cf23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Creating volume 28af3e6a-e849-455c-a2e4-0f098783fe32 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:11 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:11 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 1073741824 Sep 28 15:25:11 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:11 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 1073741824" returned: 0 in 0.463s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:11 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 Sep 28 15:25:11 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:12 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32" returned: 0 in 0.262s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7356d120-ac88-425a-af35-1065617a3590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28af3e6a-e849-455c-a2e4-0f098783fe32', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8841468-a4ca-4222-82ed-ac3b3b191370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:12 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Volume volume-28af3e6a-e849-455c-a2e4-0f098783fe32 (28af3e6a-e849-455c-a2e4-0f098783fe32): created successfully Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8841468-a4ca-4222-82ed-ac3b3b191370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Flow 'volume_create_manager' (e3d7a993-dc90-4362-9efe-79d4f5f3de5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:12 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b96d7486-bd04-40b4-b830-196a5c302d58 tempest-ProjectReaderTests-857924013 None] Created volume successfully. Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Acquiring lock "cinder-28af3e6a-e849-455c-a2e4-0f098783fe32-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Lock "cinder-28af3e6a-e849-455c-a2e4-0f098783fe32-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Acquiring lock "cinder-quobyte-28af3e6a-e849-455c-a2e4-0f098783fe32" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Lock "cinder-quobyte-28af3e6a-e849-455c-a2e4-0f098783fe32" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204b119-7300-414a-bce0-43de05630e37]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:12 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 Sep 28 15:25:12 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:12 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32" returned: 0 in 0.354s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:12 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32 Sep 28 15:25:12 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:13 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-28af3e6a-e849-455c-a2e4-0f098783fe32" returned: 0 in 0.243s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Lock "cinder-quobyte-28af3e6a-e849-455c-a2e4-0f098783fe32" released by "delete_volume" :: held 0.641s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Created reservations ['4721e624-cca7-400b-ac63-6a0ea173bb2f', '4f0ef8ed-0e6b-41fa-8f55-66198f765bd9', '00baa7f8-0133-495e-a22a-2da2ed12cff6', '7d4d6592-9588-498b-a178-a3ad2b5d6ac1'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:13 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:13 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:13 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.241s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Deleted volume successfully. Sep 28 15:25:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-71240d5c-00bd-4b53-baf2-005d1d86504e tempest-ProjectReaderTests-857924013 None] Lock "cinder-28af3e6a-e849-455c-a2e4-0f098783fe32-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Flow 'volume_create_manager' (61c24c84-b4f4-4907-8104-ce3f0497488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78259207-9ed8-4a5c-878f-253444196173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78259207-9ed8-4a5c-878f-253444196173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755207308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c7ee18-058b-40a4-87e2-3e4aac30e041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e7ea4941343fa95c2c4268be6fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:14Z,use_quota=True,user_id='63bf3a1c20ec471589407c98e685cf23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6365cfcf-ad44-4259-985b-4dd3081c7ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6365cfcf-ad44-4259-985b-4dd3081c7ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ce3404-6e2c-4291-8c92-26543ec99b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ce3404-6e2c-4291-8c92-26543ec99b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c7ee18-058b-40a4-87e2-3e4aac30e041', 'volume_name': 'volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419baa32-7ddd-4e72-ab90-b3db8415dedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419baa32-7ddd-4e72-ab90-b3db8415dedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084cb328-6c6a-41d7-b687-4c730ef78f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:14 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Volume c7c7ee18-058b-40a4-87e2-3e4aac30e041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041', 'volume_size': 1} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-755207308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c7ee18-058b-40a4-87e2-3e4aac30e041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e7ea4941343fa95c2c4268be6fafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:14Z,use_quota=True,user_id='63bf3a1c20ec471589407c98e685cf23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Creating volume c7c7ee18-058b-40a4-87e2-3e4aac30e041 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:14 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:14 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 1073741824 Sep 28 15:25:14 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:14 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 1073741824" returned: 0 in 0.462s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:14 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 Sep 28 15:25:14 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:14 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041" returned: 0 in 0.281s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084cb328-6c6a-41d7-b687-4c730ef78f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746c6832-ac69-4dc2-8ad4-7df3b74d9ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:14 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Volume volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 (c7c7ee18-058b-40a4-87e2-3e4aac30e041): created successfully Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746c6832-ac69-4dc2-8ad4-7df3b74d9ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Flow 'volume_create_manager' (61c24c84-b4f4-4907-8104-ce3f0497488d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:15 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0fb8091f-cff3-4a92-8742-17e07520c210 tempest-ProjectReaderTests-857924013 None] Created volume successfully. Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Acquiring lock "cinder-c7c7ee18-058b-40a4-87e2-3e4aac30e041-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Lock "cinder-c7c7ee18-058b-40a4-87e2-3e4aac30e041-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Acquiring lock "cinder-quobyte-c7c7ee18-058b-40a4-87e2-3e4aac30e041" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Lock "cinder-quobyte-c7c7ee18-058b-40a4-87e2-3e4aac30e041" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f3ae3e-124a-4ee3-b4d1-463d44c1e7a7]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:16 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 Sep 28 15:25:16 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:16 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:16 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041 Sep 28 15:25:16 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:16 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c7c7ee18-058b-40a4-87e2-3e4aac30e041" returned: 0 in 0.262s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Lock "cinder-quobyte-c7c7ee18-058b-40a4-87e2-3e4aac30e041" released by "delete_volume" :: held 0.712s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Created reservations ['f8478003-d1d9-4d66-999b-18e090600ca4', '32e21497-bc4b-4cfd-a031-04ad2fbbc766', '9ced7bd2-c090-4466-b727-69cc74b410ad', '29f54ebb-d908-42b3-af73-29fc1012a098'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:17 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:17 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:17 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.258s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:17 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Deleted volume successfully. Sep 28 15:25:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4dce675a-0e5b-4861-a053-8bcb611bb38c tempest-ProjectReaderTests-857924013 None] Lock "cinder-c7c7ee18-058b-40a4-87e2-3e4aac30e041-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=100,cinder:INSERT=33,cinder:UPDATE=127,cinder:DELETE=8 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:25:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:DELETE=15,cinder:UPDATE=127,cinder:SELECT=81,cinder:INSERT=35 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (8e3517fc-c67b-4848-909a-1f15f88a432e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20213fc-3378-4c35-b7ab-f60e9985593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20213fc-3378-4c35-b7ab-f60e9985593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1053013541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db5576b-dbef-4595-b519-0f78697098a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:35Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e37245-b5a3-41c2-9826-4a75d4257a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e37245-b5a3-41c2-9826-4a75d4257a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9f35a1-f3c0-493e-aa0c-fa7b319abaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9f35a1-f3c0-493e-aa0c-fa7b319abaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db5576b-dbef-4595-b519-0f78697098a0', 'volume_name': 'volume-5db5576b-dbef-4595-b519-0f78697098a0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bc4ed7-50a1-41cb-a7f2-42608e7bde84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bc4ed7-50a1-41cb-a7f2-42608e7bde84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bce3e6-8584-4c2e-bfc9-eb7e092a595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Volume 5db5576b-dbef-4595-b519-0f78697098a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db5576b-dbef-4595-b519-0f78697098a0', 'volume_size': 1} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1053013541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db5576b-dbef-4595-b519-0f78697098a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:35Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Creating volume 5db5576b-dbef-4595-b519-0f78697098a0 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:35 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:35 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 1073741824 Sep 28 15:25:35 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Flow 'volume_create_manager' (e009b434-3fc1-4221-b650-14f2aa75cd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b814f4-4545-441f-9970-bd745683a1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b814f4-4545-441f-9970-bd745683a1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1546036173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6fc01-edca-4e96-a3fa-332b78970930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec034694c474ff289fd6263119f8806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:35Z,use_quota=True,user_id='11b011bfdbda4ef5ab72cb94266e17ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340def26-5ab2-4b2c-94b1-0d87755a323b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340def26-5ab2-4b2c-94b1-0d87755a323b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296e765a-c082-4561-9333-d2c257f6c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (296e765a-c082-4561-9333-d2c257f6c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c6fc01-edca-4e96-a3fa-332b78970930', 'volume_name': 'volume-00c6fc01-edca-4e96-a3fa-332b78970930', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6992a8bc-c05b-45b5-adb7-cd9f309b322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6992a8bc-c05b-45b5-adb7-cd9f309b322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07420644-6561-4c22-b0cf-c77e7b497f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:35 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Volume 00c6fc01-edca-4e96-a3fa-332b78970930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c6fc01-edca-4e96-a3fa-332b78970930', 'volume_size': 1} Sep 28 15:25:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:36 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 1073741824" returned: 0 in 0.731s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0899dd1b-9bc2-4d17-befc-1bfbefbd93e7 tempest-ProjectAdminTests-1036028201 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1560287475586, 'free_capacity_gb': 1775.1560287475586, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86301) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:36 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 Sep 28 15:25:36 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (5c9571cb-d0f8-4c57-a2c0-0d540837e98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef71c90-d4da-4eb5-8499-2237fb723c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef71c90-d4da-4eb5-8499-2237fb723c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1025937062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa4f035-bc23-4483-8e9a-3470f551ac1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:36Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b878534b-6b53-4f3d-b6d9-e5981fce23ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b878534b-6b53-4f3d-b6d9-e5981fce23ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9ff29a-65ec-431b-8237-359c08954ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9ff29a-65ec-431b-8237-359c08954ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fa4f035-bc23-4483-8e9a-3470f551ac1f', 'volume_name': 'volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce7ece2-1924-4e01-b0dd-9d5e0ec4b782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce7ece2-1924-4e01-b0dd-9d5e0ec4b782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb0833d-db5d-45ab-a04d-5da5055c9914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Volume 4fa4f035-bc23-4483-8e9a-3470f551ac1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f', 'volume_size': 1} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0" returned: 0 in 0.400s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1546036173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6fc01-edca-4e96-a3fa-332b78970930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec034694c474ff289fd6263119f8806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:35Z,use_quota=True,user_id='11b011bfdbda4ef5ab72cb94266e17ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Creating volume 00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:36 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:36 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 1073741824 Sep 28 15:25:36 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (eff95673-e18b-4296-8207-c44337b68b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3449c810-4af2-438e-ba16-e214904745e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bce3e6-8584-4c2e-bfc9-eb7e092a595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db5576b-dbef-4595-b519-0f78697098a0', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87009224-4407-47dd-9a23-f885f0c58f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3449c810-4af2-438e-ba16-e214904745e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1685067936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06cf55c-ade2-4677-a7c2-90a4a92f9b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:36Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5affa6d0-ec71-40d5-987e-5add25ad36a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5affa6d0-ec71-40d5-987e-5add25ad36a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe61e22-81c6-47af-ab36-119abce72452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe61e22-81c6-47af-ab36-119abce72452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06cf55c-ade2-4677-a7c2-90a4a92f9b20', 'volume_name': 'volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c602d5-7ac7-45ac-a5b6-9460a62851b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c602d5-7ac7-45ac-a5b6-9460a62851b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c3073d-f1e7-4c9c-99d0-444bf8fb6fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:36 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Volume d06cf55c-ade2-4677-a7c2-90a4a92f9b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20', 'volume_size': 1} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:36 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Volume volume-5db5576b-dbef-4595-b519-0f78697098a0 (5db5576b-dbef-4595-b519-0f78697098a0): created successfully Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87009224-4407-47dd-9a23-f885f0c58f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:36 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (8e3517fc-c67b-4848-909a-1f15f88a432e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-32f34e79-47a5-49bd-ab0a-9caa24842451 tempest-CreateVolumesFromImageTest-169644895 None] Created volume successfully. Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (d64325c4-3c10-435a-9986-2decf0f6b88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d01b654-8ee1-4a98-abd4-af7878e97df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d01b654-8ee1-4a98-abd4-af7878e97df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425123487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07dca5a-365f-456f-a489-a5a389a6ec5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:37Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9681ba-c69a-4c2a-9464-3fa1eb9bdebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9681ba-c69a-4c2a-9464-3fa1eb9bdebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4c99c1-dab8-4674-bedc-3166094c6406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4c99c1-dab8-4674-bedc-3166094c6406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07dca5a-365f-456f-a489-a5a389a6ec5c', 'volume_name': 'volume-a07dca5a-365f-456f-a489-a5a389a6ec5c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ece374-e9d2-4905-8d23-87774a8fc475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ece374-e9d2-4905-8d23-87774a8fc475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2449e6ba-44fd-419b-bfcd-c4ed0e04a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Volume a07dca5a-365f-456f-a489-a5a389a6ec5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07dca5a-365f-456f-a489-a5a389a6ec5c', 'volume_size': 1} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:37 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 1073741824" returned: 0 in 0.641s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:37 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 Sep 28 15:25:37 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (565aa4df-c637-45af-8040-a9f0809df63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed0366b-0b77-49e4-a658-8f7ff7fa80f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed0366b-0b77-49e4-a658-8f7ff7fa80f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230454891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28f4801-3903-4224-ae77-8b440bbf7097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:38Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a863271-d291-40c2-9585-55fc9dc44cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a863271-d291-40c2-9585-55fc9dc44cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c9054-b33d-4d8d-896e-2cdc4194222c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50c9054-b33d-4d8d-896e-2cdc4194222c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b28f4801-3903-4224-ae77-8b440bbf7097', 'volume_name': 'volume-b28f4801-3903-4224-ae77-8b440bbf7097', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342066fb-354c-4096-b6be-949323eef7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342066fb-354c-4096-b6be-949323eef7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4cff74-4b51-40c3-8a3f-c3a61f8a6807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Volume b28f4801-3903-4224-ae77-8b440bbf7097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b28f4801-3903-4224-ae77-8b440bbf7097', 'volume_size': 1} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:37 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930" returned: 0 in 0.411s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1025937062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fa4f035-bc23-4483-8e9a-3470f551ac1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:36Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Creating volume 4fa4f035-bc23-4483-8e9a-3470f551ac1f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:37 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07420644-6561-4c22-b0cf-c77e7b497f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c6fc01-edca-4e96-a3fa-332b78970930', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f 1073741824 Sep 28 15:25:37 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2619936a-e888-4dc3-9ff8-a921c8a4da94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:37 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Volume volume-00c6fc01-edca-4e96-a3fa-332b78970930 (00c6fc01-edca-4e96-a3fa-332b78970930): created successfully Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2619936a-e888-4dc3-9ff8-a921c8a4da94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Flow 'volume_create_manager' (e009b434-3fc1-4221-b650-14f2aa75cd75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d28084be-bcdf-4754-804d-4e21e8c93ad5 tempest-VolumeDependencyTests-1297286876 None] Created volume successfully. Sep 28 15:25:38 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f 1073741824" returned: 0 in 0.584s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:38 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f Sep 28 15:25:38 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:38 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f" returned: 0 in 0.322s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.911s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1685067936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d06cf55c-ade2-4677-a7c2-90a4a92f9b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:36Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Creating volume d06cf55c-ade2-4677-a7c2-90a4a92f9b20 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:38 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb0833d-db5d-45ab-a04d-5da5055c9914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:38 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 1073741824 Sep 28 15:25:38 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f23aa-a0d3-4d44-bda1-4b5180e6514a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:38 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Volume volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f (4fa4f035-bc23-4483-8e9a-3470f551ac1f): created successfully Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f23aa-a0d3-4d44-bda1-4b5180e6514a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (5c9571cb-d0f8-4c57-a2c0-0d540837e98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e2f73d66-315b-4d35-a926-24c182ae3056 tempest-CreateVolumesFromImageTest-169644895 None] Created volume successfully. Sep 28 15:25:39 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 1073741824" returned: 0 in 0.597s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:39 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 Sep 28 15:25:39 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:39 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20" returned: 0 in 0.302s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.458s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425123487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07dca5a-365f-456f-a489-a5a389a6ec5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:37Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Creating volume a07dca5a-365f-456f-a489-a5a389a6ec5c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:39 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:39 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c 1073741824 Sep 28 15:25:39 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c3073d-f1e7-4c9c-99d0-444bf8fb6fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218334e5-3281-4ab8-80b5-7a96d635ea05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:39 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Volume volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 (d06cf55c-ade2-4677-a7c2-90a4a92f9b20): created successfully Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218334e5-3281-4ab8-80b5-7a96d635ea05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:39 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (eff95673-e18b-4296-8207-c44337b68b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-04b39b95-e02e-445a-929b-46475bf4ee32 tempest-CreateVolumesFromImageTest-169644895 None] Created volume successfully. Sep 28 15:25:40 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c 1073741824" returned: 0 in 0.587s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:40 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c Sep 28 15:25:40 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:40 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c" returned: 0 in 0.270s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230454891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28f4801-3903-4224-ae77-8b440bbf7097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9139fdd0994c40e3b24f69ea00427268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:38Z,use_quota=True,user_id='ee6f09b4de684c92aea2e97c965b0905',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Creating volume b28f4801-3903-4224-ae77-8b440bbf7097 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:40 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:40 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 1073741824 Sep 28 15:25:40 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2449e6ba-44fd-419b-bfcd-c4ed0e04a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07dca5a-365f-456f-a489-a5a389a6ec5c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6ec668-a1be-429b-86cd-5e2730377ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:40 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Volume volume-a07dca5a-365f-456f-a489-a5a389a6ec5c (a07dca5a-365f-456f-a489-a5a389a6ec5c): created successfully Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6ec668-a1be-429b-86cd-5e2730377ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:40 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (d64325c4-3c10-435a-9986-2decf0f6b88f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:40 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-af86e209-5dbd-4d6b-b931-fc2f6558be1f tempest-CreateVolumesFromImageTest-169644895 None] Created volume successfully. Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Flow 'volume_create_manager' (d265b4b0-8a0a-4c21-a096-4abcc9c49ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0046908-110b-4dc5-bab7-386bae39ebaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0046908-110b-4dc5-bab7-386bae39ebaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209c9801-78e3-4e69-a945-950be5c2cbe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155dac59c266437db78c3a0397fe7e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:41Z,use_quota=True,user_id='99ed95c7f3e946fd9d5c48aed6ca137d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e60b1e6-a306-4297-8644-a75d90367eb4),volume_type_id=8e60b1e6-a306-4297-8644-a75d90367eb4)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b237e0b1-7503-4d69-ad06-5fd6c8455f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b237e0b1-7503-4d69-ad06-5fd6c8455f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc38fa8e-5184-43de-ab2a-583467253cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:25:41 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 1073741824" returned: 0 in 0.578s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:41 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 Sep 28 15:25:41 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:41 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097" returned: 0 in 0.314s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.796s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Creating offline snapshot 0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 of volume 00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4cff74-4b51-40c3-8a3f-c3a61f8a6807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28f4801-3903-4224-ae77-8b440bbf7097', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acdda96-54b8-4b99-b2a2-4ab37835615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d716e22-30f5-46a8-a0da-9263ef4ab183]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc38fa8e-5184-43de-ab2a-583467253cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '209c9801-78e3-4e69-a945-950be5c2cbe9', 'volume_name': 'volume-209c9801-78e3-4e69-a945-950be5c2cbe9', 'volume_size': 1, 'image_id': 'fa65aed0-38f4-4144-85df-e01b7b17abe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa65aed0-38f4-4144-85df-e01b7b17abe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a48a6407feb580666ee17aaa940cff8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '155dac59c266437db78c3a0397fe7e91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5dc998fcdcedfd19be956e69164e43c6646094043c8f0458019101d299e906a78dd9de88f239fbae5227e83af68baf6ef12bba5fedd32993c09723525f9d0d0', 'id': 'fa65aed0-38f4-4144-85df-e01b7b17abe2', 'created_at': datetime.datetime(2026, 9, 28, 13, 25, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 25, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa65aed0-38f4-4144-85df-e01b7b17abe2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03989808-e03b-4eb5-8beb-8e93f19c9c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03989808-e03b-4eb5-8beb-8e93f19c9c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2def0a2-2d88-4c86-af77-894ec023da91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:41 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Volume 209c9801-78e3-4e69-a945-950be5c2cbe9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-209c9801-78e3-4e69-a945-950be5c2cbe9', 'volume_size': 1, 'image_id': 'fa65aed0-38f4-4144-85df-e01b7b17abe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa65aed0-38f4-4144-85df-e01b7b17abe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a48a6407feb580666ee17aaa940cff8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '155dac59c266437db78c3a0397fe7e91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5dc998fcdcedfd19be956e69164e43c6646094043c8f0458019101d299e906a78dd9de88f239fbae5227e83af68baf6ef12bba5fedd32993c09723525f9d0d0', 'id': 'fa65aed0-38f4-4144-85df-e01b7b17abe2', 'created_at': datetime.datetime(2026, 9, 28, 13, 25, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 25, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa65aed0-38f4-4144-85df-e01b7b17abe2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Trying to clone 209c9801-78e3-4e69-a945-950be5c2cbe9 from image fa65aed0-38f4-4144-85df-e01b7b17abe2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa65aed0-38f4-4144-85df-e01b7b17abe2', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:25:41 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Volume volume-b28f4801-3903-4224-ae77-8b440bbf7097 (b28f4801-3903-4224-ae77-8b440bbf7097): created successfully Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8acdda96-54b8-4b99-b2a2-4ab37835615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Flow 'volume_create_manager' (565aa4df-c637-45af-8040-a9f0809df63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a2da59bc-4f85-45c5-86f3-347200eb05a5 tempest-CreateVolumesFromImageTest-169644895 None] Created volume successfully. Sep 28 15:25:41 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 Sep 28 15:25:41 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:25:41 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c963d025-4928-4d7e-9bf7-55e5f654e6e8]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:42 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD Sep 28 15:25:42 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:42 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930" returned: 0 in 0.477s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:42 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 1G Sep 28 15:25:42 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:42 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-b28f4801-3903-4224-ae77-8b440bbf7097-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-b28f4801-3903-4224-ae77-8b440bbf7097-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-quobyte-b28f4801-3903-4224-ae77-8b440bbf7097" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-b28f4801-3903-4224-ae77-8b440bbf7097" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f499aa8b-e067-48e0-b0e4-75ce3c3d4a81]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:42 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD Sep 28 15:25:42 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:42 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 Sep 28 15:25:42 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:42 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 1G" returned: 0 in 0.461s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c6fc01-edca-4e96-a3fa-332b78970930 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:42 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c6fc01-edca-4e96-a3fa-332b78970930 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 Sep 28 15:25:42 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:42 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Temporary image fa65aed0-38f4-4144-85df-e01b7b17abe2 is fetched for user 99ed95c7f3e946fd9d5c48aed6ca137d. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9cbb7f-01db-45f1-b130-1d6a028a5496]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:42 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:42 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097" returned: 0 in 0.420s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:42 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:42 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097 Sep 28 15:25:42 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:42 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c6fc01-edca-4e96-a3fa-332b78970930 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" returned: 0 in 0.380s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:42 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 is being set with open permissions: ugo+rw Sep 28 15:25:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:43 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 Sep 28 15:25:43 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:43 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:43 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b28f4801-3903-4224-ae77-8b440bbf7097" returned: 0 in 0.302s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-b28f4801-3903-4224-ae77-8b440bbf7097" released by "delete_volume" :: held 0.770s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Created reservations ['01e8f529-a234-4a1f-ac77-97a33d7b2bf3', '6d689fcd-cdb7-488f-967e-7fcc3cd35da1', 'c9ce2ee8-8389-45f0-862c-62dfac8f3eb6', '4a69928d-484d-4e51-9e5e-d9fdd7f0be28'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:43 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD Sep 28 15:25:43 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:43 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" returned: 0 in 0.361s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:43 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.info Sep 28 15:25:43 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:43 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:43 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:43 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-a07dca5a-365f-456f-a489-a5a389a6ec5c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-a07dca5a-365f-456f-a489-a5a389a6ec5c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-quobyte-a07dca5a-365f-456f-a489-a5a389a6ec5c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-a07dca5a-365f-456f-a489-a5a389a6ec5c" acquired by "delete_volume" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:43 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.info" returned: 0 in 0.356s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:43 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.info is being set with open permissions: ugo+rw Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb81e148-6a88-4979-b258-7142aff2862d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:43 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.info Sep 28 15:25:43 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:43 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.403s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Deleted volume successfully. Sep 28 15:25:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-8bb3e1d6-2ad5-4f2c-9888-ccf652047cd8 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-b28f4801-3903-4224-ae77-8b440bbf7097-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:43 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c Sep 28 15:25:43 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:44 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.info" returned: 0 in 0.288s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209c9801-78e3-4e69-a945-950be5c2cbe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155dac59c266437db78c3a0397fe7e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:41Z,use_quota=True,user_id='99ed95c7f3e946fd9d5c48aed6ca137d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e60b1e6-a306-4297-8644-a75d90367eb4),volume_type_id=8e60b1e6-a306-4297-8644-a75d90367eb4)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Creating volume 209c9801-78e3-4e69-a945-950be5c2cbe9 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:44 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:44 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 1073741824 Sep 28 15:25:44 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-91d54d1d-5449-46dd-addc-e87549412da2 tempest-VolumeDependencyTests-1297286876 None] Create snapshot completed successfully Sep 28 15:25:44 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c" returned: 0 in 0.505s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:44 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c Sep 28 15:25:44 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:44 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-a07dca5a-365f-456f-a489-a5a389a6ec5c" returned: 0 in 0.296s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-a07dca5a-365f-456f-a489-a5a389a6ec5c" released by "delete_volume" :: held 0.869s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:44 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 1073741824" returned: 0 in 0.526s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:44 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 Sep 28 15:25:44 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Created reservations ['fb6b4cf9-ae9e-421c-b020-01165f60a55d', '1b90e126-2049-43e0-9edd-0c07304b9e99', 'ac1ae652-f4c7-48af-b0f5-82aa0773de7e', 'c8d3bf95-0b14-4391-b1d1-d54065742042'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:44 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:44 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-d06cf55c-ade2-4677-a7c2-90a4a92f9b20-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-d06cf55c-ade2-4677-a7c2-90a4a92f9b20-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-quobyte-d06cf55c-ade2-4677-a7c2-90a4a92f9b20" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-d06cf55c-ade2-4677-a7c2-90a4a92f9b20" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2c104b-b072-40bd-a1cb-b76aa7bf2d2b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:44 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9" returned: 0 in 0.368s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Attempting download of fa65aed0-38f4-4144-85df-e01b7b17abe2 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa65aed0-38f4-4144-85df-e01b7b17abe2', 'metadata': {}}])) to volume 209c9801-78e3-4e69-a945-950be5c2cbe9. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6137ea03-3194-4ca6-bd2f-4cf71229201c]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:45 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 Sep 28 15:25:45 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa65aed0-38f4-4144-85df-e01b7b17abe2_ezzrr7ob {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:45 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.393s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Deleted volume successfully. Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1792c7ae-5ef5-4130-8361-f9d352cc543f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-a07dca5a-365f-456f-a489-a5a389a6ec5c-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:45 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa65aed0-38f4-4144-85df-e01b7b17abe2_ezzrr7ob Sep 28 15:25:45 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:45 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20" returned: 0 in 0.557s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:45 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa65aed0-38f4-4144-85df-e01b7b17abe2_ezzrr7ob" returned: 0 in 0.450s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa65aed0-38f4-4144-85df-e01b7b17abe2_ezzrr7ob {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:45 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20 Sep 28 15:25:45 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:45 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa65aed0-38f4-4144-85df-e01b7b17abe2_ezzrr7ob Sep 28 15:25:45 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Flow 'volume_create_manager' (b464d9fe-0b9e-46bf-aadb-c918d0349f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dfd541-9120-4696-aae3-66ad3221d526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dfd541-9120-4696-aae3-66ad3221d526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-688806882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c6acf4-5a26-410b-aa06-18f01ea12748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec034694c474ff289fd6263119f8806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0404259b-be5f-4e2d-aa82-6fa5f2ce0e49,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:46Z,use_quota=True,user_id='11b011bfdbda4ef5ab72cb94266e17ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:45 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d25cdf-1943-4c77-8845-3c51caa5d5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d25cdf-1943-4c77-8845-3c51caa5d5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d10df9-79ad-4023-84a5-9f0f6fc63048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d10df9-79ad-4023-84a5-9f0f6fc63048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90c6acf4-5a26-410b-aa06-18f01ea12748', 'volume_name': 'volume-90c6acf4-5a26-410b-aa06-18f01ea12748', 'volume_size': 1, 'snapshot_id': '0404259b-be5f-4e2d-aa82-6fa5f2ce0e49'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d782df31-0a42-4ebd-aad7-4507b6b979bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d782df31-0a42-4ebd-aad7-4507b6b979bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa4143b-d2e2-4500-804b-898691263d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:45 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Volume 90c6acf4-5a26-410b-aa06-18f01ea12748: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90c6acf4-5a26-410b-aa06-18f01ea12748', 'volume_size': 1, 'snapshot_id': '0404259b-be5f-4e2d-aa82-6fa5f2ce0e49'} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d06cf55c-ade2-4677-a7c2-90a4a92f9b20" returned: 0 in 0.350s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-quobyte-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49-90c6acf4-5a26-410b-aa06-18f01ea12748" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-d06cf55c-ade2-4677-a7c2-90a4a92f9b20" released by "delete_volume" :: held 0.973s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49-90c6acf4-5a26-410b-aa06-18f01ea12748" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Creating volume 90c6acf4-5a26-410b-aa06-18f01ea12748 from snapshot 0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-quobyte-90c6acf4-5a26-410b-aa06-18f01ea12748" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-90c6acf4-5a26-410b-aa06-18f01ea12748" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] snapshot: 0404259b-be5f-4e2d-aa82-6fa5f2ce0e49, volume: 90c6acf4-5a26-410b-aa06-18f01ea12748, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:46 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa65aed0-38f4-4144-85df-e01b7b17abe2_ezzrr7ob" returned: 1 in 0.478s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa65aed0-38f4-4144-85df-e01b7b17abe2_ezzrr7ob' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5275a7e-ea56-4733-94e8-87e9214e92ac]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4929647f-77e1-429e-93c8-655fcbf6537c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Created reservations ['67651959-0280-499d-8690-f8a05a48bc90', 'b908f8e4-41f1-43d3-8c0d-3da2520ea223', '745425f3-a4a7-49ce-b5a7-6060b1ac559b', '59042ece-ba0e-4edb-885f-0b7bf2a144ed'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:46 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD Sep 28 15:25:46 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:46 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 Sep 28 15:25:46 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:46 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:46 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:46 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:46 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.306s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:46 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" returned: 0 in 0.517s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c6fc01-edca-4e96-a3fa-332b78970930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:25:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Deleted volume successfully. Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbccfb7-ea50-4dee-b630-5bfeec61913a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ea02acb6-46f6-4862-b537-05e1e8295027 tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-d06cf55c-ade2-4677-a7c2-90a4a92f9b20-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:46 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD Sep 28 15:25:46 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:46 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 Sep 28 15:25:46 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:46 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD" returned: 1 in 0.405s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] fa65aed0-38f4-4144-85df-e01b7b17abe2 was raw, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:25:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:46 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 Sep 28 15:25:46 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:47 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930" returned: 0 in 0.436s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:47 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 Sep 28 15:25:47 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-4fa4f035-bc23-4483-8e9a-3470f551ac1f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-4fa4f035-bc23-4483-8e9a-3470f551ac1f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-quobyte-4fa4f035-bc23-4483-8e9a-3470f551ac1f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-4fa4f035-bc23-4483-8e9a-3470f551ac1f" acquired by "delete_volume" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:47 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:47 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c14fd-cbcf-48bb-bd15-1f816a21ca3a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:47 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f Sep 28 15:25:47 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:47 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9" returned: 0 in 0.632s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa65aed0-38f4-4144-85df-e01b7b17abe2_i1uz8yp5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:25:47 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:47 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 1G Sep 28 15:25:47 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:47 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.396s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:25:47 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f" returned: 0 in 0.622s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:48 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f Sep 28 15:25:48 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:48 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 1G" returned: 0 in 0.772s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Downloaded image fa65aed0-38f4-4144-85df-e01b7b17abe2 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa65aed0-38f4-4144-85df-e01b7b17abe2', 'metadata': {}}])) to volume 209c9801-78e3-4e69-a945-950be5c2cbe9 successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Temporary image fa65aed0-38f4-4144-85df-e01b7b17abe2 for user 99ed95c7f3e946fd9d5c48aed6ca137d is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Marking volume 209c9801-78e3-4e69-a945-950be5c2cbe9 as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Copying metadata from image fa65aed0-38f4-4144-85df-e01b7b17abe2 to 209c9801-78e3-4e69-a945-950be5c2cbe9. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Creating volume glance metadata for volume 209c9801-78e3-4e69-a945-950be5c2cbe9 backed by image fa65aed0-38f4-4144-85df-e01b7b17abe2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fa65aed0-38f4-4144-85df-e01b7b17abe2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1a48a6407feb580666ee17aaa940cff8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:25:48 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2def0a2-2d88-4c86-af77-894ec023da91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209c9801-78e3-4e69-a945-950be5c2cbe9', 'volume_size': 1, 'image_id': 'fa65aed0-38f4-4144-85df-e01b7b17abe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa65aed0-38f4-4144-85df-e01b7b17abe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a48a6407feb580666ee17aaa940cff8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '155dac59c266437db78c3a0397fe7e91', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5dc998fcdcedfd19be956e69164e43c6646094043c8f0458019101d299e906a78dd9de88f239fbae5227e83af68baf6ef12bba5fedd32993c09723525f9d0d0', 'id': 'fa65aed0-38f4-4144-85df-e01b7b17abe2', 'created_at': datetime.datetime(2026, 9, 28, 13, 25, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 25, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa65aed0-38f4-4144-85df-e01b7b17abe2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacb9a89-0345-44a3-99b3-2fa738fc7afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4fa4f035-bc23-4483-8e9a-3470f551ac1f" returned: 0 in 0.572s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:48 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Volume volume-209c9801-78e3-4e69-a945-950be5c2cbe9 (209c9801-78e3-4e69-a945-950be5c2cbe9): created successfully Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacb9a89-0345-44a3-99b3-2fa738fc7afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Flow 'volume_create_manager' (d265b4b0-8a0a-4c21-a096-4abcc9c49ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:48 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-4fa4f035-bc23-4483-8e9a-3470f551ac1f" released by "delete_volume" :: held 1.273s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:48 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1808ea7d-7541-440b-9573-54e69e03d9b5 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Created volume successfully. Sep 28 15:25:49 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Created reservations ['ee9e14e1-220d-4c4a-bc0c-dd5cc47a3eb6', 'c37799b9-3aa6-4b14-8367-5352e8fceff6', '73dc12bc-2e8c-4d9c-a4ae-3537dbb7850a', 'd902918f-ac07-41b2-b5dd-58da3333edb9'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Acquiring lock "cinder-209c9801-78e3-4e69-a945-950be5c2cbe9-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "cinder-209c9801-78e3-4e69-a945-950be5c2cbe9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Acquiring lock "cinder-quobyte-209c9801-78e3-4e69-a945-950be5c2cbe9" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:53 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:53 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "cinder-quobyte-209c9801-78e3-4e69-a945-950be5c2cbe9" acquired by "delete_volume" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e15937-1c71-46b0-a60d-82df77298e8b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:53 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.417s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:53 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Deleted volume successfully. Sep 28 15:25:53 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 Sep 28 15:25:53 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-5db5576b-dbef-4595-b519-0f78697098a0-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-45a51b7b-c8d1-401e-9ab6-86a26714864f tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-4fa4f035-bc23-4483-8e9a-3470f551ac1f-delete_volume" released by "delete_volume" :: held 6.637s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-5db5576b-dbef-4595-b519-0f78697098a0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "cinder-quobyte-5db5576b-dbef-4595-b519-0f78697098a0" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-5db5576b-dbef-4595-b519-0f78697098a0" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c7ada8-7e7c-4521-8ff3-0c70556bf1d0]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:54 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748" returned: 0 in 7.065s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930, size 1024.00 MB, duration 7.07 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:25:54 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Converted 1024.00 MB image at 144.92 MB/s Sep 28 15:25:54 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 is being set with open permissions: ugo+rw Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:54 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 Sep 28 15:25:54 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:54 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9" returned: 0 in 0.867s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:54 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 Sep 28 15:25:54 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:54 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9 Sep 28 15:25:54 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:54 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748" returned: 0 in 0.310s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-90c6acf4-5a26-410b-aa06-18f01ea12748" released by "_copy_volume_from_snapshot" :: held 8.474s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:54 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-209c9801-78e3-4e69-a945-950be5c2cbe9" returned: 0 in 0.305s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:54 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0" returned: 0 in 0.431s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "cinder-quobyte-209c9801-78e3-4e69-a945-950be5c2cbe9" released by "delete_volume" :: held 1.292s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:54 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0 Sep 28 15:25:54 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49-90c6acf4-5a26-410b-aa06-18f01ea12748" released by "_create_volume_from_snapshot" :: held 8.591s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.613s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa4143b-d2e2-4500-804b-898691263d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c6acf4-5a26-410b-aa06-18f01ea12748', 'volume_size': 1, 'snapshot_id': '0404259b-be5f-4e2d-aa82-6fa5f2ce0e49'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf6d61a-bb09-4673-97a5-820c1e92d455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:54 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Volume volume-90c6acf4-5a26-410b-aa06-18f01ea12748 (90c6acf4-5a26-410b-aa06-18f01ea12748): created successfully Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf6d61a-bb09-4673-97a5-820c1e92d455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Flow 'volume_create_manager' (b464d9fe-0b9e-46bf-aadb-c918d0349f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Created reservations ['8875791d-f3b3-43be-967d-23db73027969', 'bab3dedc-5b3d-44f3-befd-79b744268887', '9a9d5883-e025-44c8-b190-eeb5be3214da', 'fe743a19-90e6-4902-bd28-53a164580e54'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-58346df4-27c7-4d50-a42a-0e63b485c95b tempest-VolumeDependencyTests-1297286876 None] Created volume successfully. Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:54 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:54 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:54 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5db5576b-dbef-4595-b519-0f78697098a0" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-quobyte-5db5576b-dbef-4595-b519-0f78697098a0" released by "delete_volume" :: held 0.796s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Created reservations ['91feff12-1eaf-4a7d-9115-97c3f2f2a34b', '4657ac87-1a10-47f4-9808-fff87ad5f747', '467f7c28-3a25-404f-85ff-d8df8c6e0f97', '25984d94-9b96-4ab8-a075-334946f83fcc'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-quobyte-00c6fc01-edca-4e96-a3fa-332b78970930" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:55 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:55 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-00c6fc01-edca-4e96-a3fa-332b78970930" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-quobyte-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:55 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.365s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Deleted volume successfully. Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Deleting offline snapshot 0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 of volume 00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] snapshot_file for this snap is: volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca445a29-8d18-45b9-ab89-9529b5dc29d1 tempest-VolumeAndVolumeTypeFromImageTest-1075344163 None] Lock "cinder-209c9801-78e3-4e69-a945-950be5c2cbe9-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c493d852-0b37-401e-86e6-48161fed04f6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:55 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.341s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:25:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Deleted volume successfully. Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cd9f33a0-bfef-4ed9-acb9-2e66c3cc905a tempest-CreateVolumesFromImageTest-169644895 None] Lock "cinder-5db5576b-dbef-4595-b519-0f78697098a0-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:55 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 Sep 28 15:25:55 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:55 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" returned: 0 in 0.522s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c6fc01-edca-4e96-a3fa-332b78970930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e965ce0f-9f32-4e85-9eef-460186e1897a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:55 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 Sep 28 15:25:55 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Flow 'volume_create_manager' (386a319c-f64c-44f5-9069-c691858d6df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2597e3-1746-44ac-a0b2-8d549b9aa47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2597e3-1746-44ac-a0b2-8d549b9aa47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217165955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24880f0-94ce-4027-8545-c09495e5c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb86fbd3d249490389d480e14c6c3887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:56Z,use_quota=True,user_id='f7fbdc8a7fa347788d7e48c9fe35433e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b91c196-3989-4d35-a19b-99a4410de347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b91c196-3989-4d35-a19b-99a4410de347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b422c8c-2950-49ba-aeb6-5daf4584d917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b422c8c-2950-49ba-aeb6-5daf4584d917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24880f0-94ce-4027-8545-c09495e5c55d', 'volume_name': 'volume-c24880f0-94ce-4027-8545-c09495e5c55d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bfbab5-d9b5-4ab0-97e4-ef75733bd78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bfbab5-d9b5-4ab0-97e4-ef75733bd78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ebce2d-d72c-4239-b996-e48681eac94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:56 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Volume c24880f0-94ce-4027-8545-c09495e5c55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24880f0-94ce-4027-8545-c09495e5c55d', 'volume_size': 1} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-217165955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24880f0-94ce-4027-8545-c09495e5c55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb86fbd3d249490389d480e14c6c3887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:25:56Z,use_quota=True,user_id='f7fbdc8a7fa347788d7e48c9fe35433e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Creating volume c24880f0-94ce-4027-8545-c09495e5c55d {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:56 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:56 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d 1073741824 Sep 28 15:25:56 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:56 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930" returned: 0 in 0.688s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:56 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 Sep 28 15:25:56 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:56 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:56 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d 1073741824" returned: 0 in 0.682s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" returned: 0 in 0.486s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:56 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49 Sep 28 15:25:56 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:57 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d Sep 28 15:25:57 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:57 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930.0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" returned: 0 in 0.375s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49" released by "_delete_snapshot" :: held 2.247s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-00c6fc01-edca-4e96-a3fa-332b78970930" released by "delete_snapshot" :: held 2.324s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:57 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ebce2d-d72c-4239-b996-e48681eac94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24880f0-94ce-4027-8545-c09495e5c55d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a150798-245a-4326-b26f-a5132ef60c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Volume volume-c24880f0-94ce-4027-8545-c09495e5c55d (c24880f0-94ce-4027-8545-c09495e5c55d): created successfully Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a150798-245a-4326-b26f-a5132ef60c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Flow 'volume_create_manager' (386a319c-f64c-44f5-9069-c691858d6df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dbed1ae9-7da2-448e-9faf-61cef7f59645 tempest-ProjectReaderTests-1661580067 None] Created volume successfully. Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Created reservations ['8e93f2a9-81d1-4049-a6c7-28deb571f192', '277737be-0b00-472f-bf18-8485ccee599b', '4682f180-8ff1-4397-8a3e-069ed288a0b8', 'a3f15f2c-72e4-4007-9cba-9150cc321e7e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Delete snapshot completed successfully. Sep 28 15:25:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-a4b6045e-8d08-4a1e-a973-f900892d3df1 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-0404259b-be5f-4e2d-aa82-6fa5f2ce0e49-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-00c6fc01-edca-4e96-a3fa-332b78970930-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-00c6fc01-edca-4e96-a3fa-332b78970930-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-quobyte-00c6fc01-edca-4e96-a3fa-332b78970930" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-00c6fc01-edca-4e96-a3fa-332b78970930" acquired by "delete_volume" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5320f34-367a-4800-930a-c8185b558f85]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "cinder-c24880f0-94ce-4027-8545-c09495e5c55d-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-c24880f0-94ce-4027-8545-c09495e5c55d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:58 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 Sep 28 15:25:58 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "cinder-quobyte-c24880f0-94ce-4027-8545-c09495e5c55d" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-quobyte-c24880f0-94ce-4027-8545-c09495e5c55d" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c04c8b-9d31-4f7d-b05f-5627d8cb4cb8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:25:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:58 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d Sep 28 15:25:58 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:59 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930" returned: 0 in 0.588s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:59 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930 Sep 28 15:25:59 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:59 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d" returned: 0 in 0.519s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:59 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d Sep 28 15:25:59 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:59 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-00c6fc01-edca-4e96-a3fa-332b78970930" returned: 0 in 0.336s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-00c6fc01-edca-4e96-a3fa-332b78970930" released by "delete_volume" :: held 1.034s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Created reservations ['45e29c05-e54b-4147-812c-daac9044f4e0', '766f43f6-60c3-4f0e-b71d-784cf783d7d0', '055256ab-aef7-491d-8089-79061c3ff7c1', 'a7074f0f-df62-405c-997f-17e11b092837'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:59 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c24880f0-94ce-4027-8545-c09495e5c55d" returned: 0 in 0.314s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-quobyte-c24880f0-94ce-4027-8545-c09495e5c55d" released by "delete_volume" :: held 0.890s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (44fa0ba6-1b60-4663-98a5-d73e33f7bdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12a15f2-3f29-403c-94f1-6fb1d148656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12a15f2-3f29-403c-94f1-6fb1d148656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057061912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8303f5cd-078b-47b5-9349-70fe97085a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:00Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73169ebc-9fd5-457e-88e9-d0190d7d661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73169ebc-9fd5-457e-88e9-d0190d7d661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cecd5b-3254-423e-aa00-94a0ac91b2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cecd5b-3254-423e-aa00-94a0ac91b2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8303f5cd-078b-47b5-9349-70fe97085a6c', 'volume_name': 'volume-8303f5cd-078b-47b5-9349-70fe97085a6c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c94e536-576b-4f27-93a6-bce0e23c59ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c94e536-576b-4f27-93a6-bce0e23c59ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7dfdc3-68bf-49c4-ba5a-a6db19973514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:25:59 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume 8303f5cd-078b-47b5-9349-70fe97085a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8303f5cd-078b-47b5-9349-70fe97085a6c', 'volume_size': 1} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2057061912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8303f5cd-078b-47b5-9349-70fe97085a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:00Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Creating volume 8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:25:59 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:59 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c 1073741824 Sep 28 15:25:59 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Created reservations ['4243fde8-7ed0-4792-bace-48866bd1d852', '7847fb9f-d289-4972-aa58-3be68d251eb9', '24c2b5dc-3662-40d7-a505-e0bd725d5fbf', '08964ecf-3fae-4c45-bec8-60e71cef3981'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:25:59 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:25:59 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:25:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:00 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:00 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:00 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.457s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Deleted volume successfully. Sep 28 15:26:00 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.327s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-924b683b-ddc3-476e-ac8f-1c350dff5279 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-00c6fc01-edca-4e96-a3fa-332b78970930-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Deleted volume successfully. Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9dea4082-49f0-4d25-9dd0-1c37d0e90213 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-c24880f0-94ce-4027-8545-c09495e5c55d-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:00 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c 1073741824" returned: 0 in 0.628s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:00 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c Sep 28 15:26:00 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-90c6acf4-5a26-410b-aa06-18f01ea12748-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-90c6acf4-5a26-410b-aa06-18f01ea12748-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:00 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c" returned: 0 in 0.296s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7dfdc3-68bf-49c4-ba5a-a6db19973514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8303f5cd-078b-47b5-9349-70fe97085a6c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff9b8f9-ede9-463c-8afb-2456e49db30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "cinder-quobyte-90c6acf4-5a26-410b-aa06-18f01ea12748" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume volume-8303f5cd-078b-47b5-9349-70fe97085a6c (8303f5cd-078b-47b5-9349-70fe97085a6c): created successfully Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff9b8f9-ede9-463c-8afb-2456e49db30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (44fa0ba6-1b60-4663-98a5-d73e33f7bdc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-90c6acf4-5a26-410b-aa06-18f01ea12748" acquired by "delete_volume" :: waited 0.032s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c6967376-5ce9-4002-a590-d45eae5e1591 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created volume successfully. Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a265063-2a27-45ab-bb69-55b35089e470]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:00 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 Sep 28 15:26:00 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:01 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748" returned: 0 in 0.466s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:01 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748 Sep 28 15:26:01 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Flow 'volume_create_manager' (a205d86f-bfcd-4f03-b6b9-b96be8b2e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3550ea40-218f-4181-b77d-e60facc184c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3550ea40-218f-4181-b77d-e60facc184c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286606316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f737761c-e560-413c-8307-64ad7ba61a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb86fbd3d249490389d480e14c6c3887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:01Z,use_quota=True,user_id='f7fbdc8a7fa347788d7e48c9fe35433e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37a12b0-ab27-4a5d-bb96-0dcd3f2a81e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37a12b0-ab27-4a5d-bb96-0dcd3f2a81e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f03eb2-6500-40a1-92be-c5bfdea93ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f03eb2-6500-40a1-92be-c5bfdea93ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f737761c-e560-413c-8307-64ad7ba61a1b', 'volume_name': 'volume-f737761c-e560-413c-8307-64ad7ba61a1b', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101d496f-6c4f-4777-9ba9-0560b08c9e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101d496f-6c4f-4777-9ba9-0560b08c9e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594207df-0d17-4b30-a48d-ac591e55735d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:01 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Volume f737761c-e560-413c-8307-64ad7ba61a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f737761c-e560-413c-8307-64ad7ba61a1b', 'volume_size': 1} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286606316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f737761c-e560-413c-8307-64ad7ba61a1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb86fbd3d249490389d480e14c6c3887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:01Z,use_quota=True,user_id='f7fbdc8a7fa347788d7e48c9fe35433e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Creating volume f737761c-e560-413c-8307-64ad7ba61a1b {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:01 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:01 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b 1073741824 Sep 28 15:26:01 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:01 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-90c6acf4-5a26-410b-aa06-18f01ea12748" returned: 0 in 0.292s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-quobyte-90c6acf4-5a26-410b-aa06-18f01ea12748" released by "delete_volume" :: held 0.818s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Created reservations ['84deeef3-25f3-4446-a1dd-a4fc2a37e054', 'd69196ef-3563-44cb-93ba-4b7882ecaab6', '32864f35-e46a-470c-a961-c30ce808f692', '97d7fca1-9835-4d6f-8e35-5321123b1a6e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:01 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:01 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:02 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:02 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b 1073741824" returned: 0 in 0.742s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.542s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Deleted volume successfully. Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-222ac3eb-e886-4042-bda5-ef057bbaf458 tempest-VolumeDependencyTests-1297286876 None] Lock "cinder-90c6acf4-5a26-410b-aa06-18f01ea12748-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:02 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b Sep 28 15:26:02 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:02 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b" returned: 0 in 0.283s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.380s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Creating offline snapshot d4ddfa64-c6ce-487d-8cba-8d64c50595b1 of volume 8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (594207df-0d17-4b30-a48d-ac591e55735d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f737761c-e560-413c-8307-64ad7ba61a1b', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de66310-8d1e-4928-a7b7-56585d9fe53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feec0d2-7554-4ea2-96b7-0f5c13db2266]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Volume volume-f737761c-e560-413c-8307-64ad7ba61a1b (f737761c-e560-413c-8307-64ad7ba61a1b): created successfully Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de66310-8d1e-4928-a7b7-56585d9fe53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Flow 'volume_create_manager' (a205d86f-bfcd-4f03-b6b9-b96be8b2e182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3395a2da-9cb8-4ff0-8bfd-c549721a5660 tempest-ProjectReaderTests-1661580067 None] Created volume successfully. Sep 28 15:26:02 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c Sep 28 15:26:02 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:03 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c" returned: 0 in 0.536s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:03 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 1G Sep 28 15:26:03 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "cinder-f737761c-e560-413c-8307-64ad7ba61a1b-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-f737761c-e560-413c-8307-64ad7ba61a1b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "cinder-quobyte-f737761c-e560-413c-8307-64ad7ba61a1b" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-quobyte-f737761c-e560-413c-8307-64ad7ba61a1b" acquired by "delete_volume" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[00081684-e797-4101-8bbc-a072523f4443]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:03 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 1G" returned: 0 in 0.669s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8303f5cd-078b-47b5-9349-70fe97085a6c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:03 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8303f5cd-078b-47b5-9349-70fe97085a6c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 Sep 28 15:26:03 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:03 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b Sep 28 15:26:03 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:04 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8303f5cd-078b-47b5-9349-70fe97085a6c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1" returned: 0 in 0.521s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:04 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 is being set with open permissions: ugo+rw Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:04 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 Sep 28 15:26:04 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:04 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b" returned: 0 in 0.724s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:04 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b Sep 28 15:26:04 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:04 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Flow 'volume_create_manager' (763e4166-4edb-499c-8fbf-aaf9b791285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae7277f-064c-46fc-b96b-66c100194379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1" returned: 0 in 0.444s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae7277f-064c-46fc-b96b-66c100194379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af5a2c593a44fe9a27d8102be7c377a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:05Z,use_quota=True,user_id='19ea81aa4ac2423da22b5382fb7fbd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfae462-2208-4e47-84e8-662ba89ade10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfae462-2208-4e47-84e8-662ba89ade10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b3e9bd-ced3-477f-afff-d824aa794bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.image.glance [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Creating Keystone auth plugin from conf {{(pid=86301) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 15:26:04 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f737761c-e560-413c-8307-64ad7ba61a1b" returned: 0 in 0.399s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-quobyte-f737761c-e560-413c-8307-64ad7ba61a1b" released by "delete_volume" :: held 1.200s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:05 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.info Sep 28 15:26:05 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Created reservations ['b23af98e-77b5-46ac-83d0-dc08fbc20071', 'b19844a3-82dc-41a9-8464-ed9884e2cb50', '0e9a211a-0a15-49ce-9aab-7c2273e0740e', '393ac9cd-dd16-43a6-aae9-d6151dbe9afc'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:05 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:05 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:05 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.info" returned: 0 in 0.371s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:05 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.info is being set with open permissions: ugo+rw Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:05 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.info Sep 28 15:26:05 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:05 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.344s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Deleted volume successfully. Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ce5a3188-29c1-40f9-a5ae-3bc373c49ea0 tempest-ProjectReaderTests-1661580067 None] Lock "cinder-f737761c-e560-413c-8307-64ad7ba61a1b-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8b3e9bd-ced3-477f-afff-d824aa794bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77', 'volume_name': 'volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77', 'volume_size': 1, 'image_id': '24970fc1-7c18-4c0e-8576-0309f04edaea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24970fc1-7c18-4c0e-8576-0309f04edaea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '793940aa7a18a9479fc0202855ee700a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5af5a2c593a44fe9a27d8102be7c377a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e7216908abbfd092d8d2087b44c7588dbc3b582129d42d2aa25458f3fdaf3c0da5ed40586bc24d463e7089a1fcff8fe0df8b85438d68ab3a05761c257dfb57b', 'id': '24970fc1-7c18-4c0e-8576-0309f04edaea', 'created_at': datetime.datetime(2026, 9, 28, 13, 26, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 26, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24970fc1-7c18-4c0e-8576-0309f04edaea/file', 'properties': {}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a474d587-447c-4f91-8265-3e0f34ea3006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a474d587-447c-4f91-8265-3e0f34ea3006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a38d60-37a1-42c5-8d75-d053dbdccf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:05 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Volume 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77', 'volume_size': 1, 'image_id': '24970fc1-7c18-4c0e-8576-0309f04edaea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24970fc1-7c18-4c0e-8576-0309f04edaea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '793940aa7a18a9479fc0202855ee700a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5af5a2c593a44fe9a27d8102be7c377a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e7216908abbfd092d8d2087b44c7588dbc3b582129d42d2aa25458f3fdaf3c0da5ed40586bc24d463e7089a1fcff8fe0df8b85438d68ab3a05761c257dfb57b', 'id': '24970fc1-7c18-4c0e-8576-0309f04edaea', 'created_at': datetime.datetime(2026, 9, 28, 13, 26, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 26, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24970fc1-7c18-4c0e-8576-0309f04edaea/file', 'properties': {}}, 'image_service': } Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Trying to clone 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 from image 24970fc1-7c18-4c0e-8576-0309f04edaea at location (None, [{'url': 'file:///opt/stack/data/glance/images/24970fc1-7c18-4c0e-8576-0309f04edaea', 'metadata': {}}]). {{(pid=86301) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 15:26:05 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.info" returned: 0 in 0.287s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e6790141-b814-4b98-be43-bd6e951ff3b2 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Create snapshot completed successfully Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 15:26:05 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Image download 0.00 MB at 0.00 MB/s Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d862f5f1-6e68-480b-a4b5-fe0249539ebe]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:05 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD Sep 28 15:26:05 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:06 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:06 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD Sep 28 15:26:06 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:06 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD" returned: 1 in 0.460s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:26:06 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Temporary image 24970fc1-7c18-4c0e-8576-0309f04edaea is fetched for user 19ea81aa4ac2423da22b5382fb7fbd93. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 15:26:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7012248f-f895-4c7e-a6f3-a5aa031bd0be]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:06 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD Sep 28 15:26:06 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (68554c1d-546d-412f-ae36-bc559793c98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff12117d-423e-4d68-af15-77f1e31b778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff12117d-423e-4d68-af15-77f1e31b778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386078476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01318e2-1790-42fa-b68a-72a9bccaab43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:07Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d6a414-6336-46c4-be2b-f9dd0113b77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d6a414-6336-46c4-be2b-f9dd0113b77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e92c30f-7ecd-4b89-8105-3806b40216c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e92c30f-7ecd-4b89-8105-3806b40216c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01318e2-1790-42fa-b68a-72a9bccaab43', 'volume_name': 'volume-f01318e2-1790-42fa-b68a-72a9bccaab43', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5224a71-7e05-4b1d-bc20-087955a50ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5224a71-7e05-4b1d-bc20-087955a50ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc8b72e-ee43-48a9-8db4-99bb3c48655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume f01318e2-1790-42fa-b68a-72a9bccaab43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01318e2-1790-42fa-b68a-72a9bccaab43', 'volume_size': 1} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-386078476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01318e2-1790-42fa-b68a-72a9bccaab43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:07Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Creating volume f01318e2-1790-42fa-b68a-72a9bccaab43 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:07 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:07 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD" returned: 0 in 0.578s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:07 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 1073741824 Sep 28 15:26:07 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:07 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD Sep 28 15:26:07 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:07 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (d7b9f886-4fc6-4954-a02c-8096e6e46d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3e3af9-a6c5-4a0b-b84f-e0a0dc833698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD" returned: 1 in 0.580s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3e3af9-a6c5-4a0b-b84f-e0a0dc833698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32660274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb98b5b-7b90-425b-a34d-a959feb4dceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:08Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b3806e-3548-4e24-b7a6-12ab18aaaa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b3806e-3548-4e24-b7a6-12ab18aaaa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e3de1f-9088-4cff-9ac8-856cfafaf0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0e3de1f-9088-4cff-9ac8-856cfafaf0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb98b5b-7b90-425b-a34d-a959feb4dceb', 'volume_name': 'volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac8e2c2-331c-4762-b35b-3e54f8fcb3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac8e2c2-331c-4762-b35b-3e54f8fcb3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7142fe2b-a862-4265-bfd0-13f3e8c377a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume 6fb98b5b-7b90-425b-a34d-a959feb4dceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb', 'volume_size': 1} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:08 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 1073741824" returned: 0 in 0.831s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:08 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 Sep 28 15:26:08 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (7b6f7799-589b-4950-bc2f-1e4ca8dd96af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0092db9-aa19-4c90-8ac3-40a933774d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0092db9-aa19-4c90-8ac3-40a933774d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894965430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a54ef15-3f6e-4894-82c8-fe2d7271c432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:08Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e7aac3-047e-44a7-9cef-586978b77a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e7aac3-047e-44a7-9cef-586978b77a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66220342-323b-4a4f-af94-4c26d3d9311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66220342-323b-4a4f-af94-4c26d3d9311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a54ef15-3f6e-4894-82c8-fe2d7271c432', 'volume_name': 'volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:08 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56790898-0633-4af7-8b49-a16775a82fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56790898-0633-4af7-8b49-a16775a82fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fbe66d-2233-4bab-b477-c4ed06e1b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume 7a54ef15-3f6e-4894-82c8-fe2d7271c432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432', 'volume_size': 1} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af5a2c593a44fe9a27d8102be7c377a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:05Z,use_quota=True,user_id='19ea81aa4ac2423da22b5382fb7fbd93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Creating volume 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:08 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc8b72e-ee43-48a9-8db4-99bb3c48655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01318e2-1790-42fa-b68a-72a9bccaab43', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:08 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 1073741824 Sep 28 15:26:08 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed694347-8c48-4a74-86a8-778ae6ec77f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:08 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume volume-f01318e2-1790-42fa-b68a-72a9bccaab43 (f01318e2-1790-42fa-b68a-72a9bccaab43): created successfully Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed694347-8c48-4a74-86a8-778ae6ec77f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:08 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (68554c1d-546d-412f-ae36-bc559793c98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:08 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-082abd63-4fe0-4708-82b3-0d78f06eb106 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created volume successfully. Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (fe2e86ff-c608-4c03-b9f2-d50eba6443d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d584bdd9-51f1-4718-bf1a-bd95dfbb8db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d584bdd9-51f1-4718-bf1a-bd95dfbb8db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378781590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bd038d-bef6-4279-8c86-f493a147ce99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:09Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e4726-4ee6-4726-8e5c-cccc3d37c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e4726-4ee6-4726-8e5c-cccc3d37c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b79530-b781-4703-ae28-3aa2b11fc531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31b79530-b781-4703-ae28-3aa2b11fc531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bd038d-bef6-4279-8c86-f493a147ce99', 'volume_name': 'volume-b5bd038d-bef6-4279-8c86-f493a147ce99', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb20897-ccf1-4d81-9a78-0d0175284049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb20897-ccf1-4d81-9a78-0d0175284049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf2ebcf-c35b-436a-805f-973596f91bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume b5bd038d-bef6-4279-8c86-f493a147ce99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bd038d-bef6-4279-8c86-f493a147ce99', 'volume_size': 1} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:09 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 1073741824" returned: 0 in 0.772s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:09 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 Sep 28 15:26:09 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (e40cd7de-3a4b-4c65-915c-dc07412dcda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac657a6-8b1e-4858-ae51-17782445f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac657a6-8b1e-4858-ae51-17782445f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112000829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3f8b73-080b-4a85-81e1-97e4c0f88ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:10Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88a1900-aa93-44d4-93bb-db00cfcd4d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a88a1900-aa93-44d4-93bb-db00cfcd4d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbff72d-89bf-4f72-8f77-850bdf51140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbff72d-89bf-4f72-8f77-850bdf51140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3f8b73-080b-4a85-81e1-97e4c0f88ba1', 'volume_name': 'volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6773fe-7eb2-448f-9f48-37ffc09f43f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6773fe-7eb2-448f-9f48-37ffc09f43f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0acf0b-2aac-4c8a-9dbb-fe8ad6c77043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:09 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume cd3f8b73-080b-4a85-81e1-97e4c0f88ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1', 'volume_size': 1} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:09 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77" returned: 0 in 0.428s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32660274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb98b5b-7b90-425b-a34d-a959feb4dceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:08Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Creating volume 6fb98b5b-7b90-425b-a34d-a959feb4dceb {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:09 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:09 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb 1073741824 Sep 28 15:26:09 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:09 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Attempting download of 24970fc1-7c18-4c0e-8576-0309f04edaea ((None, [{'url': 'file:///opt/stack/data/glance/images/24970fc1-7c18-4c0e-8576-0309f04edaea', 'metadata': {}}])) to volume 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b0034b-126d-4059-b869-1d9286117490]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24970fc1-7c18-4c0e-8576-0309f04edaea_pl_lz9o8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:10 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24970fc1-7c18-4c0e-8576-0309f04edaea_pl_lz9o8 Sep 28 15:26:10 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:10 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24970fc1-7c18-4c0e-8576-0309f04edaea_pl_lz9o8" returned: 0 in 0.450s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24970fc1-7c18-4c0e-8576-0309f04edaea_pl_lz9o8 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:10 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb 1073741824" returned: 0 in 0.681s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:10 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24970fc1-7c18-4c0e-8576-0309f04edaea_pl_lz9o8 Sep 28 15:26:10 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:10 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb Sep 28 15:26:10 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:10 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24970fc1-7c18-4c0e-8576-0309f04edaea_pl_lz9o8" returned: 1 in 0.434s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24970fc1-7c18-4c0e-8576-0309f04edaea_pl_lz9o8' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ecfe61-4474-4780-b382-6d4f71df4888]: (4, 'raw') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:10 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb" returned: 0 in 0.329s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.366s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894965430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a54ef15-3f6e-4894-82c8-fe2d7271c432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:08Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Creating volume 7a54ef15-3f6e-4894-82c8-fe2d7271c432 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:11 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7142fe2b-a862-4265-bfd0-13f3e8c377a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:11 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 1073741824 Sep 28 15:26:11 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:11 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff150349-79cf-4de4-986e-286c4b6976fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:11 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:11 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb (6fb98b5b-7b90-425b-a34d-a959feb4dceb): created successfully Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff150349-79cf-4de4-986e-286c4b6976fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (d7b9f886-4fc6-4954-a02c-8096e6e46d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:11 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-22f21c65-8098-4283-80fb-9ae5600f939b tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created volume successfully. Sep 28 15:26:11 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:11 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD Sep 28 15:26:11 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:11 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 1073741824" returned: 0 in 0.526s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:11 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD" returned: 1 in 0.333s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD' failed. Not Retrying. {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] 24970fc1-7c18-4c0e-8576-0309f04edaea was raw, converting to qcow2 {{(pid=86301) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 15:26:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:11 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 Sep 28 15:26:11 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:12 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 Sep 28 15:26:12 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:12 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77" returned: 0 in 0.501s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24970fc1-7c18-4c0e-8576-0309f04edaea_npc1g5h4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:26:12 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:12 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 1G Sep 28 15:26:12 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:12 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.173s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-378781590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bd038d-bef6-4279-8c86-f493a147ce99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:09Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Creating volume b5bd038d-bef6-4279-8c86-f493a147ce99 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:12 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81fbe66d-2233-4bab-b477-c4ed06e1b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11015794-63c3-474a-b475-49fc2f3ff443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:12 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 1073741824 Sep 28 15:26:12 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:12 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 1G" returned: 0 in 0.372s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Downloaded image 24970fc1-7c18-4c0e-8576-0309f04edaea ((None, [{'url': 'file:///opt/stack/data/glance/images/24970fc1-7c18-4c0e-8576-0309f04edaea', 'metadata': {}}])) to volume 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 successfully. {{(pid=86301) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Temporary image 24970fc1-7c18-4c0e-8576-0309f04edaea for user 19ea81aa4ac2423da22b5382fb7fbd93 is deleted. {{(pid=86301) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG cinder.volume.volume_utils [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Marking volume 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 as bootable. {{(pid=86301) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 15:26:12 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 1073741824" returned: 0 in 0.463s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 (7a54ef15-3f6e-4894-82c8-fe2d7271c432): created successfully Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11015794-63c3-474a-b475-49fc2f3ff443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (7b6f7799-589b-4950-bc2f-1e4ca8dd96af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Copying metadata from image 24970fc1-7c18-4c0e-8576-0309f04edaea to 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77. {{(pid=86301) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Creating volume glance metadata for volume 4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 backed by image 24970fc1-7c18-4c0e-8576-0309f04edaea with: {'image_id': '24970fc1-7c18-4c0e-8576-0309f04edaea', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '793940aa7a18a9479fc0202855ee700a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86301) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-18bf1675-c82b-431a-b5ff-51f477e1bc29 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created volume successfully. Sep 28 15:26:13 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 Sep 28 15:26:13 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a38d60-37a1-42c5-8d75-d053dbdccf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77', 'volume_size': 1, 'image_id': '24970fc1-7c18-4c0e-8576-0309f04edaea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24970fc1-7c18-4c0e-8576-0309f04edaea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '793940aa7a18a9479fc0202855ee700a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5af5a2c593a44fe9a27d8102be7c377a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e7216908abbfd092d8d2087b44c7588dbc3b582129d42d2aa25458f3fdaf3c0da5ed40586bc24d463e7089a1fcff8fe0df8b85438d68ab3a05761c257dfb57b', 'id': '24970fc1-7c18-4c0e-8576-0309f04edaea', 'created_at': datetime.datetime(2026, 9, 28, 13, 26, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 26, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24970fc1-7c18-4c0e-8576-0309f04edaea/file', 'properties': {}}, 'image_service': }' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083fd333-c5e2-41a3-8d90-ee71b41efbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:13 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99" returned: 0 in 0.255s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.546s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112000829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3f8b73-080b-4a85-81e1-97e4c0f88ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b18e8f8a9844efa91910100c0e52d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:10Z,use_quota=True,user_id='4944b60c2fc54270a23257daabe33ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Creating volume cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:13 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Volume volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 (4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77): created successfully Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083fd333-c5e2-41a3-8d90-ee71b41efbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Flow 'volume_create_manager' (763e4166-4edb-499c-8fbf-aaf9b791285b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf2ebcf-c35b-436a-805f-973596f91bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bd038d-bef6-4279-8c86-f493a147ce99', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:13 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 1073741824 Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366310e4-47fe-4fdb-8f06-9c3e07b2ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:13 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume volume-b5bd038d-bef6-4279-8c86-f493a147ce99 (b5bd038d-bef6-4279-8c86-f493a147ce99): created successfully Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366310e4-47fe-4fdb-8f06-9c3e07b2ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (fe2e86ff-c608-4c03-b9f2-d50eba6443d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a84d977e-e23c-4b0b-a0b9-572d826d99fa tempest-VolumeImageDependencyTests-118809705 None] Created volume successfully. Sep 28 15:26:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-971fc0a9-1128-4383-8851-894df323a827 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created volume successfully. Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Acquiring lock "cinder-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Lock "cinder-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:13 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 1073741824" returned: 0 in 0.586s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Acquiring lock "cinder-quobyte-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Lock "cinder-quobyte-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77" acquired by "delete_volume" :: waited 0.051s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:14 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 Sep 28 15:26:14 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ce8af-31ca-4f4d-9fd6-7ca8609e6ce8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:14 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 Sep 28 15:26:14 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:14 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1" returned: 0 in 0.298s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:14 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77" returned: 0 in 0.403s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:14 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77 Sep 28 15:26:14 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:15 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77" returned: 0 in 0.262s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Lock "cinder-quobyte-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77" released by "delete_volume" :: held 0.729s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0acf0b-2aac-4c8a-9dbb-fe8ad6c77043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10181e2b-d10e-4d27-9d61-0dd5c6b3f21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:15 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Created reservations ['997cde9f-4067-449e-8ee0-97ba4cf8f2d5', 'e32908bd-0526-4a8f-bf5e-1f0dba0fd5f3', 'f87e4281-26ae-440f-a7f5-8e940b7c5375', '2006168d-4da2-4220-bd4d-ea5b9fe2b25d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:15 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Volume volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 (cd3f8b73-080b-4a85-81e1-97e4c0f88ba1): created successfully Sep 28 15:26:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10181e2b-d10e-4d27-9d61-0dd5c6b3f21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:15 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Flow 'volume_create_manager' (e40cd7de-3a4b-4c65-915c-dc07412dcda5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f58a6909-9c05-46cf-b927-53d69f52e057 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created volume successfully. Sep 28 15:26:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:18 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:18 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:19 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.254s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:19 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Deleted volume successfully. Sep 28 15:26:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-57e822b2-1294-4d6d-93eb-d0a950c2b478 tempest-VolumeImageDependencyTests-118809705 None] Lock "cinder-4e0f0cc8-fbeb-4eff-9cdc-3d5504b1bc77-delete_volume" released by "delete_volume" :: held 5.863s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:21 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c520888e-6a75-4b73-b30d-0d1a02cd2c29]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:21 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 Sep 28 15:26:21 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:22 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1" returned: 0 in 0.375s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:22 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1 Sep 28 15:26:22 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:22 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1" returned: 0 in 0.247s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1" released by "delete_volume" :: held 0.670s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created reservations ['be75f3ca-568b-43f7-b3e4-9ca2c99f4812', '47ebc93f-c6c6-4132-9486-451dd122b04c', '237f9dfa-20b7-4824-9695-3d51d7f2ceb3', '19f7ece3-49f2-4756-aaac-a7a09347e34a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:23 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:23 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:23 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (8dd6867f-007b-479b-962a-cb8f1a36f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3418b8-2077-447c-8b25-612d0553c928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.412s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:23 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Deleted volume successfully. Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3418b8-2077-447c-8b25-612d0553c928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253165863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdaa713-a465-434c-9df7-20c3e7249903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:24Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e548a9-6a66-40ff-aee0-9b05c4fca5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e548a9-6a66-40ff-aee0-9b05c4fca5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fdfee0-4143-40ff-856b-361064d81763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fdfee0-4143-40ff-856b-361064d81763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbdaa713-a465-434c-9df7-20c3e7249903', 'volume_name': 'volume-bbdaa713-a465-434c-9df7-20c3e7249903', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07effef-7722-4364-8fb4-aca79ac3b9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07effef-7722-4364-8fb4-aca79ac3b9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a41e9d9-caaf-4101-9e94-cf3b1bdeda20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:23 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Volume bbdaa713-a465-434c-9df7-20c3e7249903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbdaa713-a465-434c-9df7-20c3e7249903', 'volume_size': 1} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253165863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbdaa713-a465-434c-9df7-20c3e7249903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:24Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Creating volume bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:23 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:23 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 1073741824 Sep 28 15:26:23 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-51c8bfd6-b58f-4234-a21f-0935a3f3481c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-cd3f8b73-080b-4a85-81e1-97e4c0f88ba1-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-b5bd038d-bef6-4279-8c86-f493a147ce99-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-b5bd038d-bef6-4279-8c86-f493a147ce99-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-b5bd038d-bef6-4279-8c86-f493a147ce99" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-b5bd038d-bef6-4279-8c86-f493a147ce99" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[282880f7-77f2-4d28-8bd8-ec07e2c9b436]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:24 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 Sep 28 15:26:24 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:24 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 1073741824" returned: 0 in 0.687s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:24 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 Sep 28 15:26:24 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:24 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99" returned: 0 in 0.607s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:24 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99 Sep 28 15:26:24 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:24 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903" returned: 0 in 0.355s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a41e9d9-caaf-4101-9e94-cf3b1bdeda20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbdaa713-a465-434c-9df7-20c3e7249903', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75922287-7233-4e99-8725-3fcbe08adab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Volume volume-bbdaa713-a465-434c-9df7-20c3e7249903 (bbdaa713-a465-434c-9df7-20c3e7249903): created successfully Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75922287-7233-4e99-8725-3fcbe08adab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (8dd6867f-007b-479b-962a-cb8f1a36f335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-73bb3f09-231d-4e52-ba46-c12e5f33710e tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:26:24 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b5bd038d-bef6-4279-8c86-f493a147ce99" returned: 0 in 0.318s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-b5bd038d-bef6-4279-8c86-f493a147ce99" released by "delete_volume" :: held 0.988s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created reservations ['a39d6452-a331-4430-8845-cf2a3908e042', 'c907a006-2d75-4bc0-afd9-33cad22eff83', '639ebaf9-93e3-4e8c-890a-a8946582ef0f', '47a01780-5fa1-4e1e-8833-c5e03b32e8c0'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:25 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:25 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:25 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.288s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Deleted volume successfully. Sep 28 15:26:25 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-4097275d-b0f6-4d3b-be39-2acca95cd0c0 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-b5bd038d-bef6-4279-8c86-f493a147ce99-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-7a54ef15-3f6e-4894-82c8-fe2d7271c432-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-7a54ef15-3f6e-4894-82c8-fe2d7271c432-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot 422f929f-906f-42e1-ade1-826ace2ca18c of volume bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff78866-c246-47e8-8e57-efe9385b4971]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-7a54ef15-3f6e-4894-82c8-fe2d7271c432" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-7a54ef15-3f6e-4894-82c8-fe2d7271c432" acquired by "delete_volume" :: waited 0.027s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a82b603-e59e-46f1-8915-5f73107a3522]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:26 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 Sep 28 15:26:26 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:26 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 Sep 28 15:26:26 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:26 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903" returned: 0 in 0.460s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:26 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c 1G Sep 28 15:26:26 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:27 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432" returned: 0 in 0.481s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:27 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432 Sep 28 15:26:27 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:27 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7a54ef15-3f6e-4894-82c8-fe2d7271c432" returned: 0 in 0.369s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-7a54ef15-3f6e-4894-82c8-fe2d7271c432" released by "delete_volume" :: held 0.925s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=132,cinder:UPDATE=181,cinder:DELETE=18,cinder:INSERT=50 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=127,cinder:UPDATE=160,cinder:INSERT=45,cinder:DELETE=15 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:27 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Flow 'volume_create_manager' (1a2ff2ac-e466-41b3-baaf-1a315e4fccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f200d0c2-cb64-4e53-be7f-7b8c441fdac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c 1G" returned: 0 in 0.683s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbdaa713-a465-434c-9df7-20c3e7249903 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f200d0c2-cb64-4e53-be7f-7b8c441fdac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b5169-0d2b-4267-ba21-3e34d19faaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901c4d7c38be4b85998f1a080aab81ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:28Z,use_quota=True,user_id='7589c7a52f7e4982a605ae3c02b50833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:27 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbdaa713-a465-434c-9df7-20c3e7249903 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c Sep 28 15:26:27 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68529d4-0054-4316-a4ff-7b162c075f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68529d4-0054-4316-a4ff-7b162c075f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a32a09-4954-44f4-813c-ea70972ba8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a32a09-4954-44f4-813c-ea70972ba8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5b5169-0d2b-4267-ba21-3e34d19faaeb', 'volume_name': 'volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa0204b-8104-4224-a836-e0f8a54eed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa0204b-8104-4224-a836-e0f8a54eed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5829b5-fd29-403d-9bd1-229253fc2299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:27 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Volume ef5b5169-0d2b-4267-ba21-3e34d19faaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb', 'volume_size': 1} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created reservations ['fdb65a89-0a46-4c41-a55c-6ff46d94f03b', 'ee689648-3a9c-43f6-b525-5c927083f0b4', 'd0a4a63a-0d40-48de-8c17-5cded6c6e697', '10c3db06-ed9b-4c1e-a9f1-989dfddc455b'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:27 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:27 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:28 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbdaa713-a465-434c-9df7-20c3e7249903 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c" returned: 0 in 0.446s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:28 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c is being set with open permissions: ugo+rw Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:28 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c Sep 28 15:26:28 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:28 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.346s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Deleted volume successfully. Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-cf16a3d5-517b-4c8a-9bc3-61d45042be2c tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-7a54ef15-3f6e-4894-82c8-fe2d7271c432-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:28 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c" returned: 0 in 0.334s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:28 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.info Sep 28 15:26:28 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-6fb98b5b-7b90-425b-a34d-a959feb4dceb-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-6fb98b5b-7b90-425b-a34d-a959feb4dceb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:28 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.info" returned: 0 in 0.302s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:28 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.info is being set with open permissions: ugo+rw Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:28 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.info Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-6fb98b5b-7b90-425b-a34d-a959feb4dceb" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:28 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-6fb98b5b-7b90-425b-a34d-a959feb4dceb" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[01905361-1cfb-434d-b668-731388b6fa44]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:28 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb Sep 28 15:26:28 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:29 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.info" returned: 0 in 0.283s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5b5169-0d2b-4267-ba21-3e34d19faaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901c4d7c38be4b85998f1a080aab81ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:28Z,use_quota=True,user_id='7589c7a52f7e4982a605ae3c02b50833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Creating volume ef5b5169-0d2b-4267-ba21-3e34d19faaeb {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:29 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:29 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb 1073741824 Sep 28 15:26:29 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-356ec33c-2f0f-4275-adc8-75a76495c277 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:26:29 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb" returned: 0 in 0.423s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:29 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb Sep 28 15:26:29 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-422f929f-906f-42e1-ade1-826ace2ca18c-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Lock "cinder-422f929f-906f-42e1-ade1-826ace2ca18c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-bbdaa713-a465-434c-9df7-20c3e7249903" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bbdaa713-a465-434c-9df7-20c3e7249903" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-422f929f-906f-42e1-ade1-826ace2ca18c" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:29 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-422f929f-906f-42e1-ade1-826ace2ca18c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot 422f929f-906f-42e1-ade1-826ace2ca18c of volume bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6fb98b5b-7b90-425b-a34d-a959feb4dceb" returned: 0 in 0.380s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-6fb98b5b-7b90-425b-a34d-a959feb4dceb" released by "delete_volume" :: held 0.862s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[943e2ecd-3281-4f7d-92fd-0b8395bb1170]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:29 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb 1073741824" returned: 0 in 0.613s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created reservations ['961ca28d-953b-451e-8a5e-95c563bc96e4', '23bb6cf4-7210-4f94-8950-8f8b031276c3', 'c5fcb2b2-f2f0-4257-a513-06edab44184f', '49478ab9-5532-4bda-9f13-df3e114fa920'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:29 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb Sep 28 15:26:29 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:29 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c Sep 28 15:26:29 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:29 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:29 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-f01318e2-1790-42fa-b68a-72a9bccaab43-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-f01318e2-1790-42fa-b68a-72a9bccaab43-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-f01318e2-1790-42fa-b68a-72a9bccaab43" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-f01318e2-1790-42fa-b68a-72a9bccaab43" acquired by "delete_volume" :: waited 0.038s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0587e91-25e0-4c47-a0cb-196ed57ab699]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:30 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb" returned: 0 in 0.485s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5829b5-fd29-403d-9bd1-229253fc2299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ed466-1bd5-439f-a33f-a2038cafdfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:30 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c" returned: 0 in 0.601s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbdaa713-a465-434c-9df7-20c3e7249903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:26:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Volume volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb (ef5b5169-0d2b-4267-ba21-3e34d19faaeb): created successfully Sep 28 15:26:30 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:30 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 Sep 28 15:26:30 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ed466-1bd5-439f-a33f-a2038cafdfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Flow 'volume_create_manager' (1a2ff2ac-e466-41b3-baaf-1a315e4fccf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b35ab9-1d9c-4729-8945-1b738a8b5e23]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.474s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Deleted volume successfully. Sep 28 15:26:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1c8d79e3-646e-4908-9663-e556db586d92 tempest-CinderUnicodeTest-1129904212 None] Created volume successfully. Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9e9cbb8c-ad99-4d22-8849-e2e4a304a9f6 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-6fb98b5b-7b90-425b-a34d-a959feb4dceb-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:30 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 Sep 28 15:26:30 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:30 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43" returned: 0 in 0.618s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:30 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43 Sep 28 15:26:30 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:30 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903" returned: 0 in 0.620s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:31 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c Sep 28 15:26:31 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:31 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f01318e2-1790-42fa-b68a-72a9bccaab43" returned: 0 in 0.448s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-f01318e2-1790-42fa-b68a-72a9bccaab43" released by "delete_volume" :: held 1.142s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created reservations ['d0637fb6-f2e7-4271-838b-7e0900d7f9bd', '246dd2e5-8949-4728-b7ba-0eb04e576811', '6db89a5d-a40f-4277-b0ea-7099d0f14ccc', '212e6b47-23a7-4e17-9289-cd6404605e93'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:31 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:31 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Flow 'volume_create_manager' (b3186584-c144-40f8-bb9d-6ee89b1de6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d2617a-6585-40b1-86d5-799619cbc48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:31 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d2617a-6585-40b1-86d5-799619cbc48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1962586152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8039504-d187-41de-b2e8-e0772fd765f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901c4d7c38be4b85998f1a080aab81ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:31Z,use_quota=True,user_id='7589c7a52f7e4982a605ae3c02b50833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57fad29-a449-466a-85cd-45e902add8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57fad29-a449-466a-85cd-45e902add8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3888c47b-c7b0-42b1-8bea-81005ae0ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3888c47b-c7b0-42b1-8bea-81005ae0ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8039504-d187-41de-b2e8-e0772fd765f3', 'volume_name': 'volume-f8039504-d187-41de-b2e8-e0772fd765f3', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0aa4cc-bddb-48a5-894c-859f8100a9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f0aa4cc-bddb-48a5-894c-859f8100a9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e51bfa6-e838-4045-a1b4-0998ad97209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:31 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Volume f8039504-d187-41de-b2e8-e0772fd765f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8039504-d187-41de-b2e8-e0772fd765f3', 'volume_size': 1} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1962586152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8039504-d187-41de-b2e8-e0772fd765f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='901c4d7c38be4b85998f1a080aab81ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:31Z,use_quota=True,user_id='7589c7a52f7e4982a605ae3c02b50833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Creating volume f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:31 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c" returned: 0 in 0.685s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:31 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 1073741824 Sep 28 15:26:31 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:31 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c Sep 28 15:26:31 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:31 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.352s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Deleted volume successfully. Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-9ab7162e-bd85-4d03-bf85-4996f6eb699f tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-f01318e2-1790-42fa-b68a-72a9bccaab43-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:31 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903.422f929f-906f-42e1-ade1-826ace2ca18c" returned: 0 in 0.305s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-422f929f-906f-42e1-ade1-826ace2ca18c" released by "_delete_snapshot" :: held 2.422s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bbdaa713-a465-434c-9df7-20c3e7249903" released by "delete_snapshot" :: held 2.453s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Created reservations ['cfffdc11-50da-4866-bf12-1a985a0c915f', '80219230-89b9-4dbe-ab9c-0bb7ad5d2105', '3f42e834-954e-4ee0-8082-dd41fbae7544', '5f68d899-48d9-4570-a0a1-480e4e7ca030'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:32 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c695c6c0-c12d-404d-9b1d-392e8eaf06b4 tempest-ProjectMemberTests-563779261 None] Lock "cinder-422f929f-906f-42e1-ade1-826ace2ca18c-delete_snapshot" released by "delete_snapshot" :: held 2.634s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:32 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 1073741824" returned: 0 in 0.607s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:32 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 Sep 28 15:26:32 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-d4ddfa64-c6ce-487d-8cba-8d64c50595b1-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-d4ddfa64-c6ce-487d-8cba-8d64c50595b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-8303f5cd-078b-47b5-9349-70fe97085a6c" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-8303f5cd-078b-47b5-9349-70fe97085a6c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-d4ddfa64-c6ce-487d-8cba-8d64c50595b1" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-d4ddfa64-c6ce-487d-8cba-8d64c50595b1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Deleting offline snapshot d4ddfa64-c6ce-487d-8cba-8d64c50595b1 of volume 8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] snapshot_file for this snap is: volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a6c79-84cb-49b5-aeb8-510927e738fe]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:32 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3" returned: 0 in 0.328s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e51bfa6-e838-4045-a1b4-0998ad97209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8039504-d187-41de-b2e8-e0772fd765f3', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6638e15b-9f8f-49ac-bb5b-b1dcc110f551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Volume volume-f8039504-d187-41de-b2e8-e0772fd765f3 (f8039504-d187-41de-b2e8-e0772fd765f3): created successfully Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6638e15b-9f8f-49ac-bb5b-b1dcc110f551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:32 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 Sep 28 15:26:32 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Flow 'volume_create_manager' (b3186584-c144-40f8-bb9d-6ee89b1de6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:32 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-eb20b486-08d5-4b11-a619-440b3fdc5db5 tempest-CinderUnicodeTest-1129904212 None] Created volume successfully. Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-bbdaa713-a465-434c-9df7-20c3e7249903-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-bbdaa713-a465-434c-9df7-20c3e7249903-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-bbdaa713-a465-434c-9df7-20c3e7249903" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bbdaa713-a465-434c-9df7-20c3e7249903" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf8a119-0e6e-4751-9d94-6bee8eff1b68]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:32 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1" returned: 0 in 0.457s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8303f5cd-078b-47b5-9349-70fe97085a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdac24e-126d-4229-b34b-509c88cc0a27]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:33 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 Sep 28 15:26:33 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:33 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c Sep 28 15:26:33 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:33 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903" returned: 0 in 0.509s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:33 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c" returned: 0 in 0.481s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:33 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903 Sep 28 15:26:33 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:33 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 Sep 28 15:26:33 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:33 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bbdaa713-a465-434c-9df7-20c3e7249903" returned: 0 in 0.331s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bbdaa713-a465-434c-9df7-20c3e7249903" released by "delete_volume" :: held 0.933s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:33 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Created reservations ['b215f0d7-1f39-47eb-9929-b1bde72b4d19', 'bb04323b-660d-4d7a-b326-c2783c330e21', '7a555747-a77d-40d0-a969-a3ee8c55d16e', '7c56b7e9-c229-4d9e-9eec-d33ec3edb983'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Creating offline snapshot ef31b83c-2a26-4331-8e6f-972b9392f431 of volume f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[872caecf-5ff9-451d-88d3-49e0f42035bd]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:34 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:34 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:34 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1" returned: 0 in 0.653s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:34 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1 Sep 28 15:26:34 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:34 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 Sep 28 15:26:34 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:34 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.436s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f561e8ee-e08f-4b65-8604-98f5c41830f1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-bbdaa713-a465-434c-9df7-20c3e7249903-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:34 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c.d4ddfa64-c6ce-487d-8cba-8d64c50595b1" returned: 0 in 0.511s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:34 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3" returned: 0 in 0.620s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-d4ddfa64-c6ce-487d-8cba-8d64c50595b1" released by "_delete_snapshot" :: held 2.315s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-8303f5cd-078b-47b5-9349-70fe97085a6c" released by "delete_snapshot" :: held 2.354s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:34 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 1G Sep 28 15:26:34 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created reservations ['e07d1dee-0cc1-479c-a7a1-b180905878e1', '73d5729c-41f1-49be-b437-24b2ef223913', 'e3232de8-777c-487a-807f-a009d72d2c1f', '04fa5656-486e-4ba3-b95c-271e3b0c2067'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Delete snapshot completed successfully. Sep 28 15:26:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1bc8f4f1-3fab-4685-990d-5476c9a47384 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-d4ddfa64-c6ce-487d-8cba-8d64c50595b1-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:35 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 1G" returned: 0 in 0.571s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8039504-d187-41de-b2e8-e0772fd765f3 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:35 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8039504-d187-41de-b2e8-e0772fd765f3 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 Sep 28 15:26:35 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-8303f5cd-078b-47b5-9349-70fe97085a6c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:35 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (f7166605-57c5-4af4-adb9-592dd2f5b6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544ef616-ee56-4b16-a463-a633bac21071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-8303f5cd-078b-47b5-9349-70fe97085a6c-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8039504-d187-41de-b2e8-e0772fd765f3 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431" returned: 0 in 0.446s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:35 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 is being set with open permissions: ugo+rw Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544ef616-ee56-4b16-a463-a633bac21071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990391552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fe818c-84de-4f90-a0bf-0d6cfa2d55c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:36Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:35 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 Sep 28 15:26:35 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a59853-718a-4010-b09b-d3f3f4a22a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62a59853-718a-4010-b09b-d3f3f4a22a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa69cf67-dc97-455d-ba78-9f8237a6de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa69cf67-dc97-455d-ba78-9f8237a6de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87fe818c-84de-4f90-a0bf-0d6cfa2d55c6', 'volume_name': 'volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94afc2c-e129-4466-a7b3-596e2f00f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94afc2c-e129-4466-a7b3-596e2f00f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518daad1-c2d2-4a1f-82f9-c4bb5f58cc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:35 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Volume 87fe818c-84de-4f90-a0bf-0d6cfa2d55c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6', 'volume_size': 1} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "cinder-quobyte-8303f5cd-078b-47b5-9349-70fe97085a6c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-8303f5cd-078b-47b5-9349-70fe97085a6c" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b381e8-7138-47e7-bb04-2e8c68914763]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:36 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c Sep 28 15:26:36 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:36 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431" returned: 0 in 0.300s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:36 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.info Sep 28 15:26:36 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:36 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c" returned: 0 in 0.412s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:36 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c Sep 28 15:26:36 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:36 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.info" returned: 0 in 0.294s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:36 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.info is being set with open permissions: ugo+rw Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:36 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.info Sep 28 15:26:36 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:36 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8303f5cd-078b-47b5-9349-70fe97085a6c" returned: 0 in 0.320s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:36 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.info" returned: 0 in 0.290s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-quobyte-8303f5cd-078b-47b5-9349-70fe97085a6c" released by "delete_volume" :: held 0.869s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-990391552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87fe818c-84de-4f90-a0bf-0d6cfa2d55c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:36Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Creating volume 87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:36 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:36 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 1073741824 Sep 28 15:26:36 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2d0e5896-c6a6-4228-a404-a14bee6ecd2d tempest-CinderUnicodeTest-1129904212 None] Create snapshot completed successfully Sep 28 15:26:36 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Created reservations ['ec1ea59f-70c3-45db-a5e5-c430bb28d1d8', '75d3488a-0266-4456-93f4-5763f6d1e480', '58ec67f0-cb1a-4601-a85b-c87c8eaf22aa', '9639a78d-dc96-45c2-952f-df391cf7c0eb'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:37 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:37 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "cinder-ef31b83c-2a26-4331-8e6f-972b9392f431-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:37 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.359s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Deleted volume successfully. Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-ef31b83c-2a26-4331-8e6f-972b9392f431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "cinder-quobyte-f8039504-d187-41de-b2e8-e0772fd765f3" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-f8039504-d187-41de-b2e8-e0772fd765f3" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "cinder-quobyte-ef31b83c-2a26-4331-8e6f-972b9392f431" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6e169134-6fa5-4810-b2a0-b798f0202a54 tempest-CreateVolumesFromSnapshotTest-1440906694 None] Lock "cinder-8303f5cd-078b-47b5-9349-70fe97085a6c-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-ef31b83c-2a26-4331-8e6f-972b9392f431" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Deleting offline snapshot ef31b83c-2a26-4331-8e6f-972b9392f431 of volume f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:26:37 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] snapshot_file for this snap is: volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 1073741824" returned: 0 in 0.694s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204315c-c356-4f4b-b726-547e0ecf8601]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:37 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 Sep 28 15:26:37 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:37 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 Sep 28 15:26:37 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:37 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" returned: 0 in 0.299s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518daad1-c2d2-4a1f-82f9-c4bb5f58cc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eca92f-4eed-460c-86e4-f67e604525d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:37 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Volume volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 (87fe818c-84de-4f90-a0bf-0d6cfa2d55c6): created successfully Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7eca92f-4eed-460c-86e4-f67e604525d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (f7166605-57c5-4af4-adb9-592dd2f5b6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e8cf48ed-b771-4327-a786-ad751e15b90a tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:26:37 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431" returned: 0 in 0.444s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8039504-d187-41de-b2e8-e0772fd765f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:26:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d376525c-ceec-4ceb-959d-277fde993b39]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:38 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 Sep 28 15:26:38 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:38 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3" returned: 0 in 0.411s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:38 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 Sep 28 15:26:38 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:38 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431" returned: 0 in 0.466s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:38 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431 Sep 28 15:26:38 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot 54b91763-4d3f-4008-9c0b-2077b45d6949 of volume 87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f010823-8e60-4cf8-9b0a-a3623d4c8a50]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:39 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3.ef31b83c-2a26-4331-8e6f-972b9392f431" returned: 0 in 0.369s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:39 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 Sep 28 15:26:39 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-ef31b83c-2a26-4331-8e6f-972b9392f431" released by "_delete_snapshot" :: held 1.881s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-f8039504-d187-41de-b2e8-e0772fd765f3" released by "delete_snapshot" :: held 1.922s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Created reservations ['96cab622-1f3e-48ad-897f-40da64500e50', '36b7e086-5f71-46b7-8d59-3b378a7f9222', '67fc6a6e-d414-4a50-bbb3-298f14d82d88', '1e5dcb53-a2a3-4c72-971c-230159b32814'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:39 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Delete snapshot completed successfully. Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3f307d8a-b271-49b7-9b4c-6e78602b3199 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-ef31b83c-2a26-4331-8e6f-972b9392f431-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:39 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" returned: 0 in 0.515s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:39 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 1G Sep 28 15:26:39 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:40 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 1G" returned: 0 in 0.480s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:40 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 Sep 28 15:26:40 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:40 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949" returned: 0 in 0.404s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:40 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 is being set with open permissions: ugo+rw Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:40 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 Sep 28 15:26:40 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "cinder-f8039504-d187-41de-b2e8-e0772fd765f3-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-f8039504-d187-41de-b2e8-e0772fd765f3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "cinder-quobyte-f8039504-d187-41de-b2e8-e0772fd765f3" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-f8039504-d187-41de-b2e8-e0772fd765f3" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b0915d-47b1-41b2-99c5-9b66cbea524b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:40 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949" returned: 0 in 0.395s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:41 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.info Sep 28 15:26:41 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:41 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 Sep 28 15:26:41 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:41 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.info" returned: 0 in 0.368s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:41 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.info is being set with open permissions: ugo+rw Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:41 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.info Sep 28 15:26:41 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:41 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3" returned: 0 in 0.606s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:41 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3 Sep 28 15:26:41 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (df547a90-2b8a-4a2b-a482-1abba7c05725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14aac3f-0517-4238-8683-78c3d1462b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:41 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.info" returned: 0 in 0.293s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.575s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14aac3f-0517-4238-8683-78c3d1462b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850619596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f7576e-2d11-4615-9c0b-4ee40a85368f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:42Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae305b7f-dbc1-4c7c-9ad7-165f927e4dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae305b7f-dbc1-4c7c-9ad7-165f927e4dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77c785-3ec8-45d6-b7bd-316440aa3c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77c785-3ec8-45d6-b7bd-316440aa3c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f7576e-2d11-4615-9c0b-4ee40a85368f', 'volume_name': 'volume-57f7576e-2d11-4615-9c0b-4ee40a85368f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10eb1497-dbf7-420c-9807-ec4294dd5c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10eb1497-dbf7-420c-9807-ec4294dd5c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934552f4-c6bb-49b2-a2fe-9eb43921f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:41 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume 57f7576e-2d11-4615-9c0b-4ee40a85368f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f7576e-2d11-4615-9c0b-4ee40a85368f', 'volume_size': 1} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850619596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f7576e-2d11-4615-9c0b-4ee40a85368f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:42Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Creating volume 57f7576e-2d11-4615-9c0b-4ee40a85368f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:41 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:41 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f 1073741824 Sep 28 15:26:41 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:41 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-91260a4c-4d07-4ac4-93f9-fb2bd1940d12 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:26:41 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-f8039504-d187-41de-b2e8-e0772fd765f3" returned: 0 in 0.311s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-f8039504-d187-41de-b2e8-e0772fd765f3" released by "delete_volume" :: held 1.011s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:41 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Created reservations ['102af211-f509-4d09-99f5-deff097824f1', '027a9534-8e38-4459-81de-6ea9cfd5278e', '2c91738f-bc55-44a7-92cd-7fd936294480', 'b68258b2-84d1-452c-8653-1dfa017b7ca1'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:42 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:42 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:42 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f 1073741824" returned: 0 in 0.502s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-54b91763-4d3f-4008-9c0b-2077b45d6949-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Lock "cinder-54b91763-4d3f-4008-9c0b-2077b45d6949-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:42 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.328s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:42 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Deleted volume successfully. Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-54b91763-4d3f-4008-9c0b-2077b45d6949" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:42 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f Sep 28 15:26:42 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-54b91763-4d3f-4008-9c0b-2077b45d6949" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot 54b91763-4d3f-4008-9c0b-2077b45d6949 of volume 87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-2ae1f2c4-275f-469a-b144-73b7ab871f43 tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-f8039504-d187-41de-b2e8-e0772fd765f3-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4212f17d-7c8d-470c-8088-433fafee7f6f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:42 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 Sep 28 15:26:42 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:42 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f" returned: 0 in 0.340s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934552f4-c6bb-49b2-a2fe-9eb43921f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f7576e-2d11-4615-9c0b-4ee40a85368f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cfaf1a-c546-4ef7-bfb9-ed1f351c3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:42 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume volume-57f7576e-2d11-4615-9c0b-4ee40a85368f (57f7576e-2d11-4615-9c0b-4ee40a85368f): created successfully Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cfaf1a-c546-4ef7-bfb9-ed1f351c3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (df547a90-2b8a-4a2b-a482-1abba7c05725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:42 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-666e5a0f-7137-46df-adce-1f97691ce8a0 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created volume successfully. Sep 28 15:26:42 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949" returned: 0 in 0.513s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:42 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "cinder-ef5b5169-0d2b-4267-ba21-3e34d19faaeb-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[df56d730-72dc-481d-a913-f3f40c6250d9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-ef5b5169-0d2b-4267-ba21-3e34d19faaeb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "cinder-quobyte-ef5b5169-0d2b-4267-ba21-3e34d19faaeb" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-ef5b5169-0d2b-4267-ba21-3e34d19faaeb" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bf1b2e-f790-4066-8652-f83647868d1d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:43 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 Sep 28 15:26:43 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:43 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb Sep 28 15:26:43 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:43 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" returned: 0 in 0.485s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:43 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 Sep 28 15:26:43 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:43 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb" returned: 0 in 0.486s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:43 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb Sep 28 15:26:43 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:44 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ef5b5169-0d2b-4267-ba21-3e34d19faaeb" returned: 0 in 0.382s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:44 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949" returned: 0 in 0.539s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-quobyte-ef5b5169-0d2b-4267-ba21-3e34d19faaeb" released by "delete_volume" :: held 0.941s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:44 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949 Sep 28 15:26:44 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Created reservations ['afbd0db8-55b8-4f69-84aa-4d87b7958172', '6ea24327-0603-49bf-b850-e3400d6623f4', 'f0753871-0436-40f2-bbd6-4aedfe23f181', '83d6a3ae-d0c6-4929-a534-bef72df64f54'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:44 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:44 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:44 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6.54b91763-4d3f-4008-9c0b-2077b45d6949" returned: 0 in 0.471s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-54b91763-4d3f-4008-9c0b-2077b45d6949" released by "_delete_snapshot" :: held 2.211s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (b47ca6c6-3bab-424f-9c88-0346de11f304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a363b4e-c650-4130-b1e5-9e65dc4b4516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" released by "delete_snapshot" :: held 2.284s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a363b4e-c650-4130-b1e5-9e65dc4b4516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574449233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:45Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963fdd9a-b066-4263-a036-60e7101f68d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963fdd9a-b066-4263-a036-60e7101f68d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f57cb7-dfef-4a18-aea4-a0bb11cb9bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f57cb7-dfef-4a18-aea4-a0bb11cb9bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12edcf2-4fb3-4e1d-99f8-040d4ad62c9a', 'volume_name': 'volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62abd51-3358-4b99-8065-adf2db3201e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62abd51-3358-4b99-8065-adf2db3201e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967380d0-30b6-457f-8108-11bdd7f74558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:44 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a', 'volume_size': 1} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574449233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:45Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Creating volume d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:44 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:44 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a 1073741824 Sep 28 15:26:44 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:44 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.491s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:44 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Deleted volume successfully. Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-d7007cd6-21ec-4dc8-a02f-ade8abf0efde tempest-CinderUnicodeTest-1129904212 None] Lock "cinder-ef5b5169-0d2b-4267-ba21-3e34d19faaeb-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:44 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Created reservations ['b2d3d4a1-2bb3-4417-9ed9-280dd849ee0d', '373cd1bf-a6a2-4737-b35d-99cbfc14d544', '84b42f11-4874-4f6b-b3c4-35a58a39a38f', '6b647a7a-400f-4867-8d99-d81f2858fa19'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ddcbf08f-c6b9-4545-9535-e1f6a6ff0b17 tempest-ProjectMemberTests-563779261 None] Lock "cinder-54b91763-4d3f-4008-9c0b-2077b45d6949-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (ab639bec-fed4-458c-b8f1-782569e0d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f2fda4-a2d2-4ab6-8619-0bb9c4617476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f2fda4-a2d2-4ab6-8619-0bb9c4617476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1486096521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:45Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6b563b-c6f9-4ca7-b210-a5e3bad91410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6b563b-c6f9-4ca7-b210-a5e3bad91410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9076fb-4c1a-4725-9f72-143d4d68fbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9076fb-4c1a-4725-9f72-143d4d68fbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29', 'volume_name': 'volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b2e970-f734-4032-9b96-82c3c759ebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b2e970-f734-4032-9b96-82c3c759ebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7637e41-cc2b-4206-9229-525e657f86b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29', 'volume_size': 1} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:45 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a 1073741824" returned: 0 in 0.909s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (30fc6abf-a0e0-4a9d-bd49-df598dac4595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2bf6ba-760b-4aa8-8238-65e5d5fdc8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2bf6ba-760b-4aa8-8238-65e5d5fdc8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1672740391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26aa69ef-51ef-4b5f-bf33-f133f3396233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:46Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7585d2f6-086d-411a-9f0e-7a801eab2e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7585d2f6-086d-411a-9f0e-7a801eab2e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2412d23f-7a55-4f0d-88e4-b8d8330d48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2412d23f-7a55-4f0d-88e4-b8d8330d48c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26aa69ef-51ef-4b5f-bf33-f133f3396233', 'volume_name': 'volume-26aa69ef-51ef-4b5f-bf33-f133f3396233', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d6d07f-4978-493c-add3-2a5707d03aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d6d07f-4978-493c-add3-2a5707d03aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df8fa24-0c27-4067-a745-41caaa4bfe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:45 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume 26aa69ef-51ef-4b5f-bf33-f133f3396233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26aa69ef-51ef-4b5f-bf33-f133f3396233', 'volume_size': 1} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Lock "cinder-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:46 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a Sep 28 15:26:46 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" acquired by "delete_volume" :: waited 0.035s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a16cbf-7afe-4c87-9b19-213522ce6bef]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:46 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a" returned: 0 in 0.391s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1486096521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:45Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Creating volume b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:46 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:46 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 Sep 28 15:26:46 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967380d0-30b6-457f-8108-11bdd7f74558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:46 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 1073741824 Sep 28 15:26:46 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108e156d-23f2-4086-b9d6-0dd1b078f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:46 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a (d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a): created successfully Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108e156d-23f2-4086-b9d6-0dd1b078f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (b47ca6c6-3bab-424f-9c88-0346de11f304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:46 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-666e1162-a0d7-4f10-95ce-314263632a4b tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created volume successfully. Sep 28 15:26:46 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" returned: 0 in 0.672s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:46 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6 Sep 28 15:26:46 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (e28e1a75-138b-4dbd-96d8-9b3b5a5db716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abad366e-8e1c-43ab-905a-b1c6efcdf24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abad366e-8e1c-43ab-905a-b1c6efcdf24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295176565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e8ed1b-2a49-4826-8ff8-0243708e41c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:47Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6032f23-1f3e-446b-bc1f-b50b4a19e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:46 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6032f23-1f3e-446b-bc1f-b50b4a19e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91b45e0-e256-4ca6-ae04-d832a2a0b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91b45e0-e256-4ca6-ae04-d832a2a0b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e8ed1b-2a49-4826-8ff8-0243708e41c2', 'volume_name': 'volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1210a38a-b7e5-411b-a043-8f82b4163566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1210a38a-b7e5-411b-a043-8f82b4163566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e5c2fa-3d7f-46cf-ab2e-19bb7b78390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:47 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume 91e8ed1b-2a49-4826-8ff8-0243708e41c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2', 'volume_size': 1} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:47 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:47 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" returned: 0 in 0.510s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 1073741824" returned: 0 in 0.952s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:47 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6" released by "delete_volume" :: held 1.290s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:47 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:47 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.358s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:26:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:47 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 Sep 28 15:26:47 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:48 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29" returned: 0 in 0.301s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.272s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1672740391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26aa69ef-51ef-4b5f-bf33-f133f3396233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:46Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Creating volume 26aa69ef-51ef-4b5f-bf33-f133f3396233 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:48 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:48 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 1073741824 Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Created reservations ['9669963b-1bf8-4b89-b25f-7e36d8997518', '00f6e14c-8e05-42a7-b94d-0b3dcc61683a', '51133056-570e-4482-a051-77d29266f3f5', 'c5819698-8f3f-4660-be05-d4d3be6818cc'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:48 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:48 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 1073741824" returned: 0 in 0.480s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7637e41-cc2b-4206-9229-525e657f86b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8507c97a-70ca-4b95-919f-42291664707c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (821a5bcd-12cd-4360-89d1-16b1ca0eec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c43d6-ba55-423d-97ae-43fa6aa02104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c43d6-ba55-423d-97ae-43fa6aa02104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-264834555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2a5741-6360-4c02-bc26-a362c8c4dcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:47Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ca4388-7bd7-4238-b038-a9e3af3e1c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ca4388-7bd7-4238-b038-a9e3af3e1c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c622db1-8bfc-4038-a836-56e93d64a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c622db1-8bfc-4038-a836-56e93d64a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2a5741-6360-4c02-bc26-a362c8c4dcad', 'volume_name': 'volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58e3c6e-5974-45ce-abe6-658050d6bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58e3c6e-5974-45ce-abe6-658050d6bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595b42c5-f90b-4911-8622-f0ed539898f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:49 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume 6b2a5741-6360-4c02-bc26-a362c8c4dcad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad', 'volume_size': 1} Sep 28 15:26:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:51 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 (b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29): created successfully Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8507c97a-70ca-4b95-919f-42291664707c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (ab639bec-fed4-458c-b8f1-782569e0d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:51 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:51 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:51 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:51 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:52 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.292s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:26:52 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233" returned: 0 in 0.356s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] <== create_volume: return (3877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.881s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295176565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e8ed1b-2a49-4826-8ff8-0243708e41c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:47Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Creating volume 91e8ed1b-2a49-4826-8ff8-0243708e41c2 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:52 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:52 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 1073741824 Sep 28 15:26:52 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:52 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 1073741824" returned: 0 in 0.443s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7d516466-7462-4917-822e-1dad8fdbb98d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created volume successfully. Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df8fa24-0c27-4067-a745-41caaa4bfe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26aa69ef-51ef-4b5f-bf33-f133f3396233', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6efd48-a8b6-4346-a83e-3605f7aa30f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 (26aa69ef-51ef-4b5f-bf33-f133f3396233): created successfully Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6efd48-a8b6-4346-a83e-3605f7aa30f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (30fc6abf-a0e0-4a9d-bd49-df598dac4595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-3cf01098-1ea8-47aa-88fb-aa3cfda84f74 tempest-ProjectMemberTests-563779261 None] Lock "cinder-87fe818c-84de-4f90-a0bf-0d6cfa2d55c6-delete_volume" released by "delete_volume" :: held 7.099s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:53 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-aabd1225-161a-46a0-88ed-cc70674f2e96 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created volume successfully. Sep 28 15:26:53 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 Sep 28 15:26:53 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:53 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2" returned: 0 in 0.412s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.095s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-264834555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2a5741-6360-4c02-bc26-a362c8c4dcad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='310ad699e84b4630840a27a9285d78a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:47Z,use_quota=True,user_id='f7e99a9b27e74bf59d41d50b009effac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Creating volume 6b2a5741-6360-4c02-bc26-a362c8c4dcad {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:53 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:53 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad 1073741824 Sep 28 15:26:53 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e5c2fa-3d7f-46cf-ab2e-19bb7b78390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623e9b83-ad69-4ef3-b47c-0ab6d2bb8a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (e7c263df-15cb-48ee-8447-ee6d7e32a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca845d2-f367-4726-8fc6-99322a4a763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca845d2-f367-4726-8fc6-99322a4a763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472601206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74aa3ff1-3652-44e5-b72d-58fa8ba76f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:53Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed21c703-11a9-4c92-b989-d384b4a01383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed21c703-11a9-4c92-b989-d384b4a01383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5947c61f-d4b3-4dc0-bb7d-b3fd2b9b5ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5947c61f-d4b3-4dc0-bb7d-b3fd2b9b5ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74aa3ff1-3652-44e5-b72d-58fa8ba76f25', 'volume_name': 'volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d61f710-1d53-410b-b611-d1764abdaa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d61f710-1d53-410b-b611-d1764abdaa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23847b07-ec4a-4e28-b5d1-d701fe9852fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Volume 74aa3ff1-3652-44e5-b72d-58fa8ba76f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25', 'volume_size': 1} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:53 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 (91e8ed1b-2a49-4826-8ff8-0243708e41c2): created successfully Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (623e9b83-ad69-4ef3-b47c-0ab6d2bb8a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (e28e1a75-138b-4dbd-96d8-9b3b5a5db716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:53 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-66a2f5d4-0888-4026-b593-296b49e75271 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created volume successfully. Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Flow 'volume_create_manager' (12f20886-8a66-45fc-bb0f-95fd83e4d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de15f3fa-3955-44c9-a14d-b8efd55165dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de15f3fa-3955-44c9-a14d-b8efd55165dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1199688071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b288e3c-1048-4ffb-8d0c-46d0748e8334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85f708cf11d4c56b6bae047775bf3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:54Z,use_quota=True,user_id='6015f4253b914ab78c9dc583044f3715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a450a4fc-05cd-48a5-b81b-be0fcc280a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a450a4fc-05cd-48a5-b81b-be0fcc280a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d408f6a-2a02-47fe-91c0-85952d283c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d408f6a-2a02-47fe-91c0-85952d283c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b288e3c-1048-4ffb-8d0c-46d0748e8334', 'volume_name': 'volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db14e22-bf17-4908-9f7d-7d34ce26c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db14e22-bf17-4908-9f7d-7d34ce26c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2406aaf5-07c3-4b1e-a504-5e7f0d42842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:53 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Volume 5b288e3c-1048-4ffb-8d0c-46d0748e8334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334', 'volume_size': 1} Sep 28 15:26:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:54 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad 1073741824" returned: 0 in 0.549s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:54 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad Sep 28 15:26:54 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:54 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad" returned: 0 in 0.268s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-472601206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74aa3ff1-3652-44e5-b72d-58fa8ba76f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:53Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Creating volume 74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:54 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595b42c5-f90b-4911-8622-f0ed539898f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c143cc7-b659-4350-92fd-339e46ac05de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:54 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 1073741824 Sep 28 15:26:54 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:54 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Volume volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad (6b2a5741-6360-4c02-bc26-a362c8c4dcad): created successfully Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c143cc7-b659-4350-92fd-339e46ac05de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Flow 'volume_create_manager' (821a5bcd-12cd-4360-89d1-16b1ca0eec2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-099cacb9-a946-4c56-a84b-253f6539b70a tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created volume successfully. Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-6b2a5741-6360-4c02-bc26-a362c8c4dcad-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-6b2a5741-6360-4c02-bc26-a362c8c4dcad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-quobyte-6b2a5741-6360-4c02-bc26-a362c8c4dcad" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-6b2a5741-6360-4c02-bc26-a362c8c4dcad" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3c8ae6-bd29-4951-bbe7-072947abff2b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:54 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad Sep 28 15:26:54 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:54 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 1073741824" returned: 0 in 0.620s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:55 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 Sep 28 15:26:55 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:55 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad" returned: 0 in 0.480s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:55 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad Sep 28 15:26:55 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:55 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" returned: 0 in 0.330s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1199688071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b288e3c-1048-4ffb-8d0c-46d0748e8334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85f708cf11d4c56b6bae047775bf3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:26:54Z,use_quota=True,user_id='6015f4253b914ab78c9dc583044f3715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Creating volume 5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:26:55 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23847b07-ec4a-4e28-b5d1-d701fe9852fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b04131-50b2-4967-bb42-9c8551a2296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:55 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 1073741824 Sep 28 15:26:55 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:55 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Volume volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 (74aa3ff1-3652-44e5-b72d-58fa8ba76f25): created successfully Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b04131-50b2-4967-bb42-9c8551a2296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (e7c263df-15cb-48ee-8447-ee6d7e32a64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cfd4484e-8043-45e1-ab51-4501c3bedf7a tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:26:55 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-6b2a5741-6360-4c02-bc26-a362c8c4dcad" returned: 0 in 0.335s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-6b2a5741-6360-4c02-bc26-a362c8c4dcad" released by "delete_volume" :: held 0.870s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created reservations ['bb890226-8ff9-4cf2-9f17-a43c276f4336', '8fba10f0-7b0a-436b-86df-fc26e9efddf7', '6ea764fd-b31a-4550-8ffc-8fc7029fde42', '380302e2-51ab-4e3b-8c4b-80f541f58e0b'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:55 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:55 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-91e8ed1b-2a49-4826-8ff8-0243708e41c2-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-91e8ed1b-2a49-4826-8ff8-0243708e41c2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-quobyte-91e8ed1b-2a49-4826-8ff8-0243708e41c2" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-91e8ed1b-2a49-4826-8ff8-0243708e41c2" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:56 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 1073741824" returned: 0 in 0.662s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce32a71-aa3a-4119-abf3-72cf28539e88]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:56 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:56 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.382s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:56 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Deleted volume successfully. Sep 28 15:26:56 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 Sep 28 15:26:56 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06202737-930f-4789-bfe4-39e5c1129618 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-6b2a5741-6360-4c02-bc26-a362c8c4dcad-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:56 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334" returned: 0 in 0.300s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2406aaf5-07c3-4b1e-a504-5e7f0d42842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc840cb1-faee-4099-8277-4ef613c4062a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:26:56 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Volume volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 (5b288e3c-1048-4ffb-8d0c-46d0748e8334): created successfully Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc840cb1-faee-4099-8277-4ef613c4062a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Flow 'volume_create_manager' (12f20886-8a66-45fc-bb0f-95fd83e4d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:26:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6df1abc0-f681-4af0-a176-c56028515aac tempest-SnapshotDependencyTests-340760354 None] Created volume successfully. Sep 28 15:26:56 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2" returned: 0 in 0.474s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:56 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2 Sep 28 15:26:56 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:56 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-91e8ed1b-2a49-4826-8ff8-0243708e41c2" returned: 0 in 0.313s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-91e8ed1b-2a49-4826-8ff8-0243708e41c2" released by "delete_volume" :: held 0.877s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Creating offline snapshot 8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 of volume 74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:26:56 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd180f44-841f-4e47-b794-2531f6298e1a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created reservations ['9f65da64-64e2-4c65-9696-528a54e7096f', '3cd0b0e3-45a0-4469-8d7a-2fec546af117', 'fab9c2d2-576f-47cf-8155-9a96dbf06b8d', '91cd6887-9b5d-4c6f-9a07-5980382036a4'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:57 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 Sep 28 15:26:57 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:57 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:57 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:57 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" returned: 0 in 0.476s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:57 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 1G Sep 28 15:26:57 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:57 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.307s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:57 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Deleted volume successfully. Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682d102f-1472-443e-a633-94402002f68c tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-91e8ed1b-2a49-4826-8ff8-0243708e41c2-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:57 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 1G" returned: 0 in 0.497s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:58 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 Sep 28 15:26:58 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-26aa69ef-51ef-4b5f-bf33-f133f3396233-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-26aa69ef-51ef-4b5f-bf33-f133f3396233-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:58 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" returned: 0 in 0.376s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:58 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 is being set with open permissions: ugo+rw Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:58 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 Sep 28 15:26:58 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-quobyte-26aa69ef-51ef-4b5f-bf33-f133f3396233" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-26aa69ef-51ef-4b5f-bf33-f133f3396233" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b79217-f361-4b9f-9f3d-70c3bd4bed3a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:58 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 Sep 28 15:26:58 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:58 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" returned: 0 in 0.310s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:58 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.info Sep 28 15:26:58 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:58 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233" returned: 0 in 0.433s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:58 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233 Sep 28 15:26:58 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:59 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.info" returned: 0 in 0.307s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:59 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.info is being set with open permissions: ugo+rw Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:59 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.info Sep 28 15:26:59 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:59 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-26aa69ef-51ef-4b5f-bf33-f133f3396233" returned: 0 in 0.340s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-26aa69ef-51ef-4b5f-bf33-f133f3396233" released by "delete_volume" :: held 0.840s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created reservations ['87fc5040-d0db-44f6-ad06-f897d247843d', 'd8e03a64-d530-4f80-9124-127cc6525491', '62c50871-5693-464a-a395-ce198ef9f8e2', '3fdf6e1a-be86-49bc-a6df-596eeb9d41c6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:26:59 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.info" returned: 0 in 0.325s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.076s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Creating offline snapshot ed43629e-b34a-443c-9f2d-ad264b48e4fb of volume 5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[60039215-97cf-4244-a7dd-cd3855540152]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-8dd841bc-9232-487c-a8f6-4b10aad4fbac tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:59 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:26:59 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:59 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 Sep 28 15:26:59 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:26:59 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.289s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:26:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Deleted volume successfully. Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-384488d9-1c2b-49c7-ad74-cf9a9f3f321d tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-26aa69ef-51ef-4b5f-bf33-f133f3396233-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:26:59 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334" returned: 0 in 0.470s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:26:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:26:59 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb 1G Sep 28 15:26:59 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Lock "cinder-8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot 8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 of volume 74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a673196a-958c-41ca-a501-4d07eb4594bc]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:00 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 Sep 28 15:27:00 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:00 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb 1G" returned: 0 in 0.614s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:00 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb Sep 28 15:27:00 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-quobyte-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29" acquired by "delete_volume" :: waited 0.029s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf3c8f5-fcb3-4896-ab47-10b3286220f2]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:00 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" returned: 0 in 0.580s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:00 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 Sep 28 15:27:00 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6869df-98e4-4316-bc4b-e97fbe906950]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 Sep 28 15:27:01 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:01 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb" returned: 0 in 0.600s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:01 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb is being set with open permissions: ugo+rw Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb Sep 28 15:27:01 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:01 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29" returned: 0 in 0.597s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29 Sep 28 15:27:01 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:01 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" returned: 0 in 0.486s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb" returned: 0 in 0.330s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:01 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 Sep 28 15:27:01 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.info Sep 28 15:27:01 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:01 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29" returned: 0 in 0.336s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29" released by "delete_volume" :: held 1.012s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created reservations ['2152ef93-08f7-4d5e-9afc-8c4b4588c4c4', '9ecb6e0a-c84e-40d8-82a8-0146be3babfb', 'c8ef1971-c376-4c3a-9ac6-d56da0208a52', '9b10c061-c5f0-42f2-b427-2ca03908d8d1'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:01 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.info" returned: 0 in 0.325s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:01 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.info is being set with open permissions: ugo+rw Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.info Sep 28 15:27:01 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:01 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" returned: 0 in 0.455s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:01 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1 Sep 28 15:27:01 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:01 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:01 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:02 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.info" returned: 0 in 0.284s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:02 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dffc2503-1d4b-4fbb-ad0b-520176257c97 tempest-SnapshotDependencyTests-340760354 None] Create snapshot completed successfully Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25.8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" returned: 0 in 0.295s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1" released by "_delete_snapshot" :: held 1.978s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" released by "delete_snapshot" :: held 2.013s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:02 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.344s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Deleted volume successfully. Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ca83922e-8127-49f9-bd4b-7dad578582a3 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-b0c14fbf-8b7d-4bca-a3e8-7dbb3c994c29-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Created reservations ['295a3ed8-5a4f-4d03-be7d-2d2d76d6b2f0', 'a39b5b0c-3d40-4cb3-9ebb-6c00aaaacbcb', '92281f24-ddcc-4ccb-ab74-f3796804d161', '6045cc6e-5fe2-45f7-bde9-e8daa5f377f6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-154f71e6-99de-447c-b319-75f1b31f0f3f tempest-ProjectMemberTests-563779261 None] Lock "cinder-8eeb7400-5fd1-4abb-ba8d-53c1d1dd5ff1-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-quobyte-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[648a6161-03f1-47e5-8c64-523599284cb6]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:03 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a Sep 28 15:27:03 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Flow 'volume_create_manager' (7b0110b5-87ff-4c8a-8121-83c8aacdcbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f26c883-7548-41cc-86f6-47b7b25741e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f26c883-7548-41cc-86f6-47b7b25741e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582c957d-2ed9-4f5c-94eb-ea00a22d500b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e85f708cf11d4c56b6bae047775bf3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed43629e-b34a-443c-9f2d-ad264b48e4fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:03Z,use_quota=True,user_id='6015f4253b914ab78c9dc583044f3715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef89f241-f2b3-417b-b718-ba1104150a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef89f241-f2b3-417b-b718-ba1104150a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec8685-49b1-4ed3-a900-b20a6d682704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ec8685-49b1-4ed3-a900-b20a6d682704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '582c957d-2ed9-4f5c-94eb-ea00a22d500b', 'volume_name': 'volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b', 'volume_size': 1, 'snapshot_id': 'ed43629e-b34a-443c-9f2d-ad264b48e4fb'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238cb29b-5370-4840-8ca8-baf59464b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238cb29b-5370-4840-8ca8-baf59464b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c995e3ff-ca19-4ca3-98f3-8217667b204a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:03 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Volume 582c957d-2ed9-4f5c-94eb-ea00a22d500b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b', 'volume_size': 1, 'snapshot_id': 'ed43629e-b34a-443c-9f2d-ad264b48e4fb'} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-quobyte-ed43629e-b34a-443c-9f2d-ad264b48e4fb-582c957d-2ed9-4f5c-94eb-ea00a22d500b" by "_create_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-ed43629e-b34a-443c-9f2d-ad264b48e4fb-582c957d-2ed9-4f5c-94eb-ea00a22d500b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Creating volume 582c957d-2ed9-4f5c-94eb-ea00a22d500b from snapshot ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-quobyte-582c957d-2ed9-4f5c-94eb-ea00a22d500b" by "_copy_volume_from_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-582c957d-2ed9-4f5c-94eb-ea00a22d500b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] snapshot: ed43629e-b34a-443c-9f2d-ad264b48e4fb, volume: 582c957d-2ed9-4f5c-94eb-ea00a22d500b, {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-74aa3ff1-3652-44e5-b72d-58fa8ba76f25-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Lock "cinder-74aa3ff1-3652-44e5-b72d-58fa8ba76f25-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdcdfa5-7b4e-4626-b561-dddf18ae517b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:03 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a" returned: 0 in 0.487s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:03 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a Sep 28 15:27:03 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:03 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb Sep 28 15:27:03 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ace9e0-a6f6-4ddb-9e67-3d50287fcbfd]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:03 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 Sep 28 15:27:03 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:03 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a" returned: 0 in 0.285s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a" released by "delete_volume" :: held 0.832s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:03 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb" returned: 0 in 0.427s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b50e9d-00c1-4772-9f81-b897123eab59]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:03 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created reservations ['fc4f5df1-1672-4188-97dd-bbe75e48732a', '5186f05e-0e6a-4f91-90be-e5d406fe34e9', '1ebf082f-bcc4-4396-8954-1b0356162e23', 'd8485291-088d-449b-b4ce-08539ff588ff'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:04 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 Sep 28 15:27:04 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:04 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:04 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:04 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" returned: 0 in 0.526s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:04 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25 Sep 28 15:27:04 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:04 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.316s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Deleted volume successfully. Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-72565ba6-5fd2-422f-a116-cd2c12344202 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-d12edcf2-4fb3-4e1d-99f8-040d4ad62c9a-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:04 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334" returned: 0 in 0.537s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Creating direct copy from snapshot {{(pid=86301) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.utils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Path /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b not found in is_blk_device check {{(pid=86301) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:04 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" returned: 0 in 0.333s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:04 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b Sep 28 15:27:04 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-74aa3ff1-3652-44e5-b72d-58fa8ba76f25" released by "delete_volume" :: held 0.934s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Created reservations ['b8909c0d-5f55-49ee-94b8-dbfca24917e0', '4650103f-a76f-4ed1-a9af-f7450a9ac929', '4df4ad3f-efd5-4e7c-87ee-8252f6196763', 'c718340e-1044-4f7d-9bdc-3ba6b913b88b'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:04 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:04 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:04 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.303s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:04 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:27:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-06bbcabc-e1f0-4b2c-beeb-533cce0dbcdd tempest-ProjectMemberTests-563779261 None] Lock "cinder-74aa3ff1-3652-44e5-b72d-58fa8ba76f25-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-57f7576e-2d11-4615-9c0b-4ee40a85368f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-57f7576e-2d11-4615-9c0b-4ee40a85368f-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "cinder-quobyte-57f7576e-2d11-4615-9c0b-4ee40a85368f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:05 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-57f7576e-2d11-4615-9c0b-4ee40a85368f" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:05 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76b0a9e-6559-4797-97a8-996be84c892c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:05 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f Sep 28 15:27:05 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:06 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f" returned: 0 in 0.625s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:06 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f Sep 28 15:27:06 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:06 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-57f7576e-2d11-4615-9c0b-4ee40a85368f" returned: 0 in 0.734s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-quobyte-57f7576e-2d11-4615-9c0b-4ee40a85368f" released by "delete_volume" :: held 1.475s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:06 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:27:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (c61af2a6-e114-45a6-b9c5-c2ac88a60082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:06 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d74dd51-9966-4a83-ab1e-26707c6e2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d74dd51-9966-4a83-ab1e-26707c6e2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451950663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b92e97e-be0c-4382-adae-519295bd35b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:07Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ed8c88-ea50-4bb5-8c6d-1208b611dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ed8c88-ea50-4bb5-8c6d-1208b611dc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8960ec0-d78c-4362-9fca-6a540f5a1c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8960ec0-d78c-4362-9fca-6a540f5a1c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b92e97e-be0c-4382-adae-519295bd35b2', 'volume_name': 'volume-4b92e97e-be0c-4382-adae-519295bd35b2', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b62c5c8-3b25-492c-8065-800e9776380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b62c5c8-3b25-492c-8065-800e9776380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8308fb1-d317-4a5d-a876-3a6f8cf107ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:07 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Volume 4b92e97e-be0c-4382-adae-519295bd35b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b92e97e-be0c-4382-adae-519295bd35b2', 'volume_size': 1} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Created reservations ['42657218-6aa7-4652-baef-52e353c21ea0', '7b62e94d-4b5b-4ef4-9153-13dc7d055c09', 'b143f0b9-0ddc-4d71-a005-0c8dae420fce', '7e14ab4d-9ece-42ce-8a9c-c60c87eb2522'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:07 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:07 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:07 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.576s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:07 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Deleted volume successfully. Sep 28 15:27:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-f34ab352-bc60-4466-899d-039ad5071b33 tempest-CreateVolumesFromSourceVolumeTest-1961026217 None] Lock "cinder-57f7576e-2d11-4615-9c0b-4ee40a85368f-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:13 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b" returned: 0 in 8.630s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.image.image_utils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Image conversion details: src /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b {{(pid=86301) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 15:27:13 devstack cinder-volume[86301]: INFO cinder.image.image_utils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Converted 1024.00 MB image at 118.65 MB/s Sep 28 15:27:13 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b is being set with open permissions: ugo+rw Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:13 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b Sep 28 15:27:13 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:13 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b" returned: 0 in 0.282s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-582c957d-2ed9-4f5c-94eb-ea00a22d500b" released by "_copy_volume_from_snapshot" :: held 9.999s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-ed43629e-b34a-443c-9f2d-ad264b48e4fb-582c957d-2ed9-4f5c-94eb-ea00a22d500b" released by "_create_volume_from_snapshot" :: held 10.087s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.105s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.370s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451950663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b92e97e-be0c-4382-adae-519295bd35b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:07Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Creating volume 4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:27:13 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:13 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 1073741824 Sep 28 15:27:13 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c995e3ff-ca19-4ca3-98f3-8217667b204a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b', 'volume_size': 1, 'snapshot_id': 'ed43629e-b34a-443c-9f2d-ad264b48e4fb'}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ab1076-bfb8-4c85-9233-40c41d8ff58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:13 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Volume volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b (582c957d-2ed9-4f5c-94eb-ea00a22d500b): created successfully Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ab1076-bfb8-4c85-9233-40c41d8ff58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:13 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Flow 'volume_create_manager' (7b0110b5-87ff-4c8a-8121-83c8aacdcbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-01de08b7-4ebc-4f49-9f95-575949191505 tempest-SnapshotDependencyTests-340760354 None] Created volume successfully. Sep 28 15:27:14 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 1073741824" returned: 0 in 0.607s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:14 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 Sep 28 15:27:14 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:14 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2" returned: 0 in 0.252s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8308fb1-d317-4a5d-a876-3a6f8cf107ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b92e97e-be0c-4382-adae-519295bd35b2', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3343ab-454e-4f91-a0da-9e57cc166183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:14 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Volume volume-4b92e97e-be0c-4382-adae-519295bd35b2 (4b92e97e-be0c-4382-adae-519295bd35b2): created successfully Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3343ab-454e-4f91-a0da-9e57cc166183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (c61af2a6-e114-45a6-b9c5-c2ac88a60082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0ce81777-426b-4f7e-8485-62f45bd37a3c tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-ed43629e-b34a-443c-9f2d-ad264b48e4fb-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-ed43629e-b34a-443c-9f2d-ad264b48e4fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-quobyte-5b288e3c-1048-4ffb-8d0c-46d0748e8334" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-5b288e3c-1048-4ffb-8d0c-46d0748e8334" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-quobyte-ed43629e-b34a-443c-9f2d-ad264b48e4fb" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-ed43629e-b34a-443c-9f2d-ad264b48e4fb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Deleting offline snapshot ed43629e-b34a-443c-9f2d-ad264b48e4fb of volume 5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] snapshot_file for this snap is: volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4fb8e0-c125-4f8a-b9fb-7639121ba530]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:14 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb Sep 28 15:27:14 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot 5a1286e1-8099-474c-9d5b-0118e627bf33 of volume 4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc3656b-eaa0-48b5-8fdc-2bdbcb42c56c]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:15 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 Sep 28 15:27:15 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:15 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb" returned: 0 in 0.413s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f07b1d7-4384-42ef-a9a4-1e920f263465]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:15 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 Sep 28 15:27:15 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:15 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2" returned: 0 in 0.447s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:15 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 1G Sep 28 15:27:15 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:15 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334" returned: 0 in 0.632s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:15 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb Sep 28 15:27:15 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:15 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 1G" returned: 0 in 0.492s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b92e97e-be0c-4382-adae-519295bd35b2 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:15 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b92e97e-be0c-4382-adae-519295bd35b2 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 Sep 28 15:27:15 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:16 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b92e97e-be0c-4382-adae-519295bd35b2 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33" returned: 0 in 0.325s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:16 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 is being set with open permissions: ugo+rw Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:16 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb" returned: 0 in 0.395s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:16 devstack sudo[108681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 Sep 28 15:27:16 devstack sudo[108681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:16 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb Sep 28 15:27:16 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:16 devstack sudo[108681]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33" returned: 0 in 0.256s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:16 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334.ed43629e-b34a-443c-9f2d-ad264b48e4fb" returned: 0 in 0.276s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:16 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.info Sep 28 15:27:16 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-ed43629e-b34a-443c-9f2d-ad264b48e4fb" released by "_delete_snapshot" :: held 1.845s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-5b288e3c-1048-4ffb-8d0c-46d0748e8334" released by "delete_snapshot" :: held 1.875s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Created reservations ['0d0b31c3-43ba-497d-b049-105b6c4eec97', 'aa5a3922-823d-40c9-a24b-6e0773fc2efb', '0a716092-5419-43b6-99d6-db6a043ac306', 'c1c564e4-8369-44bd-9708-17c4a8156b58'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Delete snapshot completed successfully. Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-910f1ac2-2149-4905-86ee-f28f810c7332 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-ed43629e-b34a-443c-9f2d-ad264b48e4fb-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:16 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.info" returned: 0 in 0.254s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:16 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.info is being set with open permissions: ugo+rw Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:16 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.info Sep 28 15:27:16 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-5b288e3c-1048-4ffb-8d0c-46d0748e8334-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-5b288e3c-1048-4ffb-8d0c-46d0748e8334-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-quobyte-5b288e3c-1048-4ffb-8d0c-46d0748e8334" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-5b288e3c-1048-4ffb-8d0c-46d0748e8334" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f2662c-297b-419e-9638-dbdf822b155e]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:17 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.info" returned: 0 in 0.307s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:17 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fd25e387-f95a-4dbd-9aae-fc8fe537f208 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:27:17 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 Sep 28 15:27:17 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:17 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334" returned: 0 in 0.410s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:17 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334 Sep 28 15:27:17 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:17 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-5b288e3c-1048-4ffb-8d0c-46d0748e8334" returned: 0 in 0.283s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-5b288e3c-1048-4ffb-8d0c-46d0748e8334" released by "delete_volume" :: held 0.796s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Created reservations ['b7e3fd83-5118-4ba9-ae30-a62a99c79392', '1c1905e4-e7fe-416f-b7da-5aa10f737cc6', '2cb52c93-dd64-4cf0-99f4-4693872ce87c', 'a919bf94-ddcf-4f1c-b06f-6f7aade4ba64'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:17 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:17 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-582c957d-2ed9-4f5c-94eb-ea00a22d500b-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-582c957d-2ed9-4f5c-94eb-ea00a22d500b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-5a1286e1-8099-474c-9d5b-0118e627bf33-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Lock "cinder-5a1286e1-8099-474c-9d5b-0118e627bf33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-4b92e97e-be0c-4382-adae-519295bd35b2" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "cinder-quobyte-582c957d-2ed9-4f5c-94eb-ea00a22d500b" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-4b92e97e-be0c-4382-adae-519295bd35b2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-5a1286e1-8099-474c-9d5b-0118e627bf33" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-582c957d-2ed9-4f5c-94eb-ea00a22d500b" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-5a1286e1-8099-474c-9d5b-0118e627bf33" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot 5a1286e1-8099-474c-9d5b-0118e627bf33 of volume 4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de64445-a500-45a3-861a-6a2ff920bc41]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:18 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.352s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d6ec3c-d5e4-4191-88ce-e68548575bbc]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:18 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Deleted volume successfully. Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ebc2487b-76b5-4628-9a21-5eeb5242b2ca tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-5b288e3c-1048-4ffb-8d0c-46d0748e8334-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:18 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b Sep 28 15:27:18 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:18 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 Sep 28 15:27:18 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:18 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:18 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b Sep 28 15:27:18 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:18 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33" returned: 0 in 0.423s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b92e97e-be0c-4382-adae-519295bd35b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd4206a-0e7c-4629-a58a-da75a1f49f34]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:18 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 Sep 28 15:27:18 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:18 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-582c957d-2ed9-4f5c-94eb-ea00a22d500b" returned: 0 in 0.287s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-quobyte-582c957d-2ed9-4f5c-94eb-ea00a22d500b" released by "delete_volume" :: held 0.745s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:18 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Created reservations ['325b7701-720b-42cf-aea2-b8ec47c7b8f1', '14334e31-a8bd-4454-8bdf-0e4078e5fa4c', 'df0a35bc-7235-4c80-87fb-5d5544575043', 'cabf2942-7dc0-4434-86fe-096ace876de0'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:19 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:19 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:19 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2" returned: 0 in 0.440s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:19 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 Sep 28 15:27:19 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:19 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.364s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:19 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Deleted volume successfully. Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b1205e07-d60d-4886-8102-413eee1dada7 tempest-SnapshotDependencyTests-340760354 None] Lock "cinder-582c957d-2ed9-4f5c-94eb-ea00a22d500b-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:19 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33" returned: 0 in 0.448s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:19 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33 Sep 28 15:27:19 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:19 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2.5a1286e1-8099-474c-9d5b-0118e627bf33" returned: 0 in 0.289s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-5a1286e1-8099-474c-9d5b-0118e627bf33" released by "_delete_snapshot" :: held 1.742s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:19 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-4b92e97e-be0c-4382-adae-519295bd35b2" released by "delete_snapshot" :: held 1.788s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Created reservations ['10862f8a-e6cb-4569-be9d-81f123436f9f', 'd2199ab5-5bab-41de-baad-e57d0770e980', 'e261c6d6-3a2c-49d5-a911-52a0185e6de5', '1354674f-12a4-4f13-bf41-ee4e166ce717'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-682fb7ed-01df-4fcf-8fff-2e5df5353cd0 tempest-ProjectMemberTests-563779261 None] Lock "cinder-5a1286e1-8099-474c-9d5b-0118e627bf33-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-4b92e97e-be0c-4382-adae-519295bd35b2-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-4b92e97e-be0c-4382-adae-519295bd35b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-4b92e97e-be0c-4382-adae-519295bd35b2" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-4b92e97e-be0c-4382-adae-519295bd35b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[32956ff7-c99e-466f-a9a9-906bf6cf428b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:20 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 Sep 28 15:27:20 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:20 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2" returned: 0 in 0.421s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:20 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2 Sep 28 15:27:20 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:21 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-4b92e97e-be0c-4382-adae-519295bd35b2" returned: 0 in 0.313s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-4b92e97e-be0c-4382-adae-519295bd35b2" released by "delete_volume" :: held 0.815s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Created reservations ['e96c5011-8b69-4a19-8cd8-b469f3fe8efb', '154badf1-57fa-41f5-ba1f-770b783042ec', '4aa6dd64-6a1b-4268-af25-47dc6e32b9b6', 'b2552005-9634-4657-a424-9fc2dc8ef791'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:21 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:21 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:21 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.280s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:27:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-657e904a-d6cd-4cf2-9d04-3eb82441f0a1 tempest-ProjectMemberTests-563779261 None] Lock "cinder-4b92e97e-be0c-4382-adae-519295bd35b2-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (2f0f5cf8-c67e-481f-9b4a-6fd97de26b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5764796-58ee-4ae8-9da1-8eb381448630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5764796-58ee-4ae8-9da1-8eb381448630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460707615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7058759-462d-4a89-afd3-054256c34d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:22Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8311257a-72d8-46f0-aac1-7a47d350d617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8311257a-72d8-46f0-aac1-7a47d350d617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36ed8ea-1cef-4a0e-98e4-cce266c3891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36ed8ea-1cef-4a0e-98e4-cce266c3891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7058759-462d-4a89-afd3-054256c34d4a', 'volume_name': 'volume-e7058759-462d-4a89-afd3-054256c34d4a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95971ad9-4fcc-4a7a-910c-ccf5228605c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95971ad9-4fcc-4a7a-910c-ccf5228605c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab44176-77f4-44ae-ad0c-60b22df0b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:22 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Volume e7058759-462d-4a89-afd3-054256c34d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7058759-462d-4a89-afd3-054256c34d4a', 'volume_size': 1} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1460707615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7058759-462d-4a89-afd3-054256c34d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:22Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Creating volume e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:27:22 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:22 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a 1073741824 Sep 28 15:27:22 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:22 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a 1073741824" returned: 0 in 0.435s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:22 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a Sep 28 15:27:22 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:22 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a" returned: 0 in 0.248s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab44176-77f4-44ae-ad0c-60b22df0b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7058759-462d-4a89-afd3-054256c34d4a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e39346-10c9-4af2-84eb-d70280386062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:22 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Volume volume-e7058759-462d-4a89-afd3-054256c34d4a (e7058759-462d-4a89-afd3-054256c34d4a): created successfully Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e39346-10c9-4af2-84eb-d70280386062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:22 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (2f0f5cf8-c67e-481f-9b4a-6fd97de26b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:22 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6dcfca8f-d878-4ff0-8363-8890e80f18cf tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:27:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot 42e8e8a4-600e-44ce-90b1-2e623c32fadf of volume e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:27:23 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d5b834-465a-492f-925e-16c6b74c5c73]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:23 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a Sep 28 15:27:23 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:23 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a" returned: 0 in 0.386s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:23 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf 1G Sep 28 15:27:23 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:24 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf 1G" returned: 0 in 0.525s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7058759-462d-4a89-afd3-054256c34d4a -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:24 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7058759-462d-4a89-afd3-054256c34d4a -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf Sep 28 15:27:24 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:24 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7058759-462d-4a89-afd3-054256c34d4a -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf" returned: 0 in 0.333s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:24 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf is being set with open permissions: ugo+rw Sep 28 15:27:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:24 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf Sep 28 15:27:24 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:24 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf" returned: 0 in 0.249s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:24 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.info Sep 28 15:27:24 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:25 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.info" returned: 0 in 0.280s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:25 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.info is being set with open permissions: ugo+rw Sep 28 15:27:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:25 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.info Sep 28 15:27:25 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:25 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.info" returned: 0 in 0.251s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:25 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-14243349-92c1-4517-bfee-867c179ab9c7 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-42e8e8a4-600e-44ce-90b1-2e623c32fadf-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Lock "cinder-42e8e8a4-600e-44ce-90b1-2e623c32fadf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-e7058759-462d-4a89-afd3-054256c34d4a" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-e7058759-462d-4a89-afd3-054256c34d4a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-42e8e8a4-600e-44ce-90b1-2e623c32fadf" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-42e8e8a4-600e-44ce-90b1-2e623c32fadf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot 42e8e8a4-600e-44ce-90b1-2e623c32fadf of volume e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebde47cc-a9fa-4261-84ad-3adfd1b24e70]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:26 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf Sep 28 15:27:26 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:26 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf" returned: 0 in 0.365s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:26 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7058759-462d-4a89-afd3-054256c34d4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:27 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b474a0c9-15dc-461b-a2ca-ea3930bbace5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:27 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a Sep 28 15:27:27 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:27 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a" returned: 0 in 0.355s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:27 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf Sep 28 15:27:27 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:27 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf" returned: 0 in 0.414s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:27 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf Sep 28 15:27:27 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:28 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a.42e8e8a4-600e-44ce-90b1-2e623c32fadf" returned: 0 in 0.256s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-42e8e8a4-600e-44ce-90b1-2e623c32fadf" released by "_delete_snapshot" :: held 1.492s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-e7058759-462d-4a89-afd3-054256c34d4a" released by "delete_snapshot" :: held 1.515s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:INSERT=57,cinder:SELECT=170,cinder:UPDATE=225,cinder:DELETE=22 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=180,cinder:UPDATE=244,cinder:INSERT=64,cinder:DELETE=17 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Created reservations ['178df5d1-e883-4927-890f-f3aa3234b307', 'c94a4814-2263-4be0-9d7a-5628c9b9c2f6', '4ceb2734-3a79-42c6-8491-66900059df20', '1d3de1cc-9ffe-4737-9c0d-48dce850a40d'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:28 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5bd03bcd-8e26-4b52-933e-48e2c42af0f8 tempest-ProjectMemberTests-563779261 None] Lock "cinder-42e8e8a4-600e-44ce-90b1-2e623c32fadf-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-e7058759-462d-4a89-afd3-054256c34d4a-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Lock "cinder-e7058759-462d-4a89-afd3-054256c34d4a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-e7058759-462d-4a89-afd3-054256c34d4a" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-e7058759-462d-4a89-afd3-054256c34d4a" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a49cd75-51a7-4305-b7c1-347a1840e9da]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:28 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a Sep 28 15:27:28 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:29 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a" returned: 0 in 0.386s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:29 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a Sep 28 15:27:29 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:29 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e7058759-462d-4a89-afd3-054256c34d4a" returned: 0 in 0.281s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-e7058759-462d-4a89-afd3-054256c34d4a" released by "delete_volume" :: held 0.739s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Created reservations ['61485804-f8a4-40f2-9cde-b88c07524a39', '1e7ce7cd-fe0c-4f67-8b44-d37f4fce8589', '0185952e-d5eb-4e05-ad87-2434565f8c1f', 'c80be6da-b71c-459c-a255-e5b9bc5a9eed'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:29 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:29 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:29 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.260s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:27:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-10e58848-73f5-4721-8ab9-d198c369ea25 tempest-ProjectMemberTests-563779261 None] Lock "cinder-e7058759-462d-4a89-afd3-054256c34d4a-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (2a8cefc7-3db1-4f27-bf19-23b90c180c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dde908b-bbfe-4428-95ee-7b8ea814b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dde908b-bbfe-4428-95ee-7b8ea814b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486158411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a187473-8992-4086-855e-8016c9874995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:30Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a81e13-d640-4fbc-b3b3-ad9a40f0e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42a81e13-d640-4fbc-b3b3-ad9a40f0e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d0dd9-3411-439c-aeb8-c4b7832189f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74d0dd9-3411-439c-aeb8-c4b7832189f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a187473-8992-4086-855e-8016c9874995', 'volume_name': 'volume-8a187473-8992-4086-855e-8016c9874995', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6aecc7-69c7-4d24-a3aa-34c62158bdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6aecc7-69c7-4d24-a3aa-34c62158bdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6478540-329e-49dc-9339-dfd08fbac2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:30 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Volume 8a187473-8992-4086-855e-8016c9874995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a187473-8992-4086-855e-8016c9874995', 'volume_size': 1} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486158411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a187473-8992-4086-855e-8016c9874995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:30Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Creating volume 8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:27:30 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:30 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 1073741824 Sep 28 15:27:30 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:30 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 1073741824" returned: 0 in 0.422s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:31 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 Sep 28 15:27:31 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:31 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995" returned: 0 in 0.258s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6478540-329e-49dc-9339-dfd08fbac2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a187473-8992-4086-855e-8016c9874995', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774b0772-44f5-4a87-b275-05d94323471a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:31 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Volume volume-8a187473-8992-4086-855e-8016c9874995 (8a187473-8992-4086-855e-8016c9874995): created successfully Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774b0772-44f5-4a87-b275-05d94323471a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (2a8cefc7-3db1-4f27-bf19-23b90c180c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:31 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1589fdd0-cba7-41f2-903a-5e8202417f0a tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot aba000a4-2ec5-4d5f-a44a-16364caa2621 of volume 8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eeea0f0-a3ea-44b0-91e9-df86c27d8a17]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:31 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 Sep 28 15:27:31 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:31 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995" returned: 0 in 0.355s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:31 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 1G Sep 28 15:27:31 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:32 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 1G" returned: 0 in 0.388s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a187473-8992-4086-855e-8016c9874995 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:32 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a187473-8992-4086-855e-8016c9874995 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 Sep 28 15:27:32 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:32 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a187473-8992-4086-855e-8016c9874995 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621" returned: 0 in 0.291s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:32 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 is being set with open permissions: ugo+rw Sep 28 15:27:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:32 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 Sep 28 15:27:32 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:32 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621" returned: 0 in 0.225s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:32 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.info Sep 28 15:27:32 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:33 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.info" returned: 0 in 0.252s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:33 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.info is being set with open permissions: ugo+rw Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:33 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.info Sep 28 15:27:33 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:33 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.info" returned: 0 in 0.242s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:33 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-d2102a78-c0a6-4179-be31-83f11010ad06 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-aba000a4-2ec5-4d5f-a44a-16364caa2621-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Lock "cinder-aba000a4-2ec5-4d5f-a44a-16364caa2621-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-8a187473-8992-4086-855e-8016c9874995" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-8a187473-8992-4086-855e-8016c9874995" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-aba000a4-2ec5-4d5f-a44a-16364caa2621" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-aba000a4-2ec5-4d5f-a44a-16364caa2621" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot aba000a4-2ec5-4d5f-a44a-16364caa2621 of volume 8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b95e388-3b7e-44df-81a6-ed2e1de6618a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:33 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 Sep 28 15:27:33 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:34 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621" returned: 0 in 0.357s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a187473-8992-4086-855e-8016c9874995(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b8979a-7c57-4209-bc81-90ffec2118cb]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:34 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 Sep 28 15:27:34 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:34 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995" returned: 0 in 0.342s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:34 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 Sep 28 15:27:34 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:34 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621" returned: 0 in 0.324s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:34 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621 Sep 28 15:27:34 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:35 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995.aba000a4-2ec5-4d5f-a44a-16364caa2621" returned: 0 in 0.238s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-aba000a4-2ec5-4d5f-a44a-16364caa2621" released by "_delete_snapshot" :: held 1.355s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-8a187473-8992-4086-855e-8016c9874995" released by "delete_snapshot" :: held 1.376s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Created reservations ['dd891676-bed7-4527-a01b-f5e927bebb45', '7ffba055-109d-4333-aaef-14133c846c64', '6801b065-a325-4123-9d24-f0eaecc88ff9', 'c50313ab-5cf2-4681-b4be-602d57646bb7'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:35 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5a145cbf-3b55-484b-b2eb-3b1f0d363c70 tempest-ProjectMemberTests-563779261 None] Lock "cinder-aba000a4-2ec5-4d5f-a44a-16364caa2621-delete_snapshot" released by "delete_snapshot" :: held 1.501s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-8a187473-8992-4086-855e-8016c9874995-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Lock "cinder-8a187473-8992-4086-855e-8016c9874995-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-8a187473-8992-4086-855e-8016c9874995" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-8a187473-8992-4086-855e-8016c9874995" acquired by "delete_volume" :: waited 0.023s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2d9bc0-b5b0-468a-af32-9e6cbb09f090]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:36 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 Sep 28 15:27:36 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:36 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995" returned: 0 in 0.351s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:36 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995 Sep 28 15:27:36 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:36 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-8a187473-8992-4086-855e-8016c9874995" returned: 0 in 0.230s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-8a187473-8992-4086-855e-8016c9874995" released by "delete_volume" :: held 0.639s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Created reservations ['aeb548ec-2a4e-441a-9cb0-6daf478ba61f', '0351e219-1118-4b0e-a56c-c79e525909fc', '6c030b33-e277-437e-9b20-c915dacef2e0', '2a816db2-a331-49a8-b007-d6c47d1b344e'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:36 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:36 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:36 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.226s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:27:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-89f0d307-4d71-4ade-a0ea-b8df0184e414 tempest-ProjectMemberTests-563779261 None] Lock "cinder-8a187473-8992-4086-855e-8016c9874995-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (0ccb092f-0ec5-42cc-b13f-bd5b0866e0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d63d43f-f5be-429f-812c-cc73325b7381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d63d43f-f5be-429f-812c-cc73325b7381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393126700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde34743-516e-49df-befd-5d4761c095b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:37Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5e7acd-6452-4402-bba1-5d18ca5f1886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5e7acd-6452-4402-bba1-5d18ca5f1886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fa415c-1134-4115-aa01-2911b0c6d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fa415c-1134-4115-aa01-2911b0c6d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde34743-516e-49df-befd-5d4761c095b5', 'volume_name': 'volume-bde34743-516e-49df-befd-5d4761c095b5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c5f83c-4c11-47d1-be04-188ac522b5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c5f83c-4c11-47d1-be04-188ac522b5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71b4a86-0d38-4059-a162-9522f836eaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:37 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Volume bde34743-516e-49df-befd-5d4761c095b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde34743-516e-49df-befd-5d4761c095b5', 'volume_size': 1} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393126700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde34743-516e-49df-befd-5d4761c095b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:37Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Creating volume bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:27:37 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:37 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 1073741824 Sep 28 15:27:37 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:37 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 1073741824" returned: 0 in 0.417s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:37 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 Sep 28 15:27:37 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:38 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5" returned: 0 in 0.250s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71b4a86-0d38-4059-a162-9522f836eaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde34743-516e-49df-befd-5d4761c095b5', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7bb45b-ed4a-4e79-a6b5-70d23e030db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:38 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Volume volume-bde34743-516e-49df-befd-5d4761c095b5 (bde34743-516e-49df-befd-5d4761c095b5): created successfully Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7bb45b-ed4a-4e79-a6b5-70d23e030db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (0ccb092f-0ec5-42cc-b13f-bd5b0866e0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:38 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bd1c3a84-c66b-477f-8315-37039aa13c92 tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot f0a9118e-0445-45ad-b94b-3d01805c66fe of volume bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd208c-b69c-4ca8-a9f0-ae9e926784ac]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:38 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:38 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 Sep 28 15:27:38 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:39 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5" returned: 0 in 0.381s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:39 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe 1G Sep 28 15:27:39 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:39 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe 1G" returned: 0 in 0.385s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde34743-516e-49df-befd-5d4761c095b5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:39 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde34743-516e-49df-befd-5d4761c095b5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe Sep 28 15:27:39 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:39 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bde34743-516e-49df-befd-5d4761c095b5 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe" returned: 0 in 0.295s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:39 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe is being set with open permissions: ugo+rw Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:39 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe Sep 28 15:27:39 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:39 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe" returned: 0 in 0.234s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:39 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:39 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.info Sep 28 15:27:39 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:40 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.info" returned: 0 in 0.260s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:40 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.info is being set with open permissions: ugo+rw Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:40 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.info Sep 28 15:27:40 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:40 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.info" returned: 0 in 0.238s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:40 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0082c084-b5a1-4cd5-be75-5822ddbeea53 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-f0a9118e-0445-45ad-b94b-3d01805c66fe-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Lock "cinder-f0a9118e-0445-45ad-b94b-3d01805c66fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-bde34743-516e-49df-befd-5d4761c095b5" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bde34743-516e-49df-befd-5d4761c095b5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-f0a9118e-0445-45ad-b94b-3d01805c66fe" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-f0a9118e-0445-45ad-b94b-3d01805c66fe" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot f0a9118e-0445-45ad-b94b-3d01805c66fe of volume bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0723ae8e-281e-4526-934a-00ab3b01225d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:40 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:40 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe Sep 28 15:27:40 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:41 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe" returned: 0 in 0.366s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bde34743-516e-49df-befd-5d4761c095b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd58124-8c00-4bbb-8dff-b01e22c8999b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:41 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 Sep 28 15:27:41 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:41 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5" returned: 0 in 0.358s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:41 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe Sep 28 15:27:41 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:41 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe" returned: 0 in 0.321s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:41 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:41 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe Sep 28 15:27:41 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:42 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5.f0a9118e-0445-45ad-b94b-3d01805c66fe" returned: 0 in 0.243s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-f0a9118e-0445-45ad-b94b-3d01805c66fe" released by "_delete_snapshot" :: held 1.383s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bde34743-516e-49df-befd-5d4761c095b5" released by "delete_snapshot" :: held 1.404s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Created reservations ['fd3c90b3-dbab-4c2b-9855-ac765272a2bb', '2d89d16d-a1aa-41e0-a22a-6bc6f168eea9', 'f45fc45e-7261-4a30-974f-333b2136db87', '5244633d-8beb-4b9d-bc19-309f146cccf6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:42 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-042939f6-4636-4248-a45f-caa85d8bacfb tempest-ProjectMemberTests-563779261 None] Lock "cinder-f0a9118e-0445-45ad-b94b-3d01805c66fe-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-bde34743-516e-49df-befd-5d4761c095b5-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Lock "cinder-bde34743-516e-49df-befd-5d4761c095b5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-bde34743-516e-49df-befd-5d4761c095b5" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:42 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bde34743-516e-49df-befd-5d4761c095b5" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[654f20d3-a316-4c0a-b4c6-9f7d338fc7b3]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:43 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 Sep 28 15:27:43 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:43 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5" returned: 0 in 0.354s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:43 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5 Sep 28 15:27:43 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:43 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-bde34743-516e-49df-befd-5d4761c095b5" returned: 0 in 0.240s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-bde34743-516e-49df-befd-5d4761c095b5" released by "delete_volume" :: held 0.659s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Created reservations ['a25584d9-783b-4c01-b346-ff20150a7d97', 'f45f4520-fb53-4e91-8918-e649b796ebef', 'a39723d5-dded-49fc-8119-9d7e1486972c', '60ddcd9e-7038-4cd8-97f7-7b68dfbf71d8'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:43 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:43 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:43 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.236s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:43 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:43 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-eb7141b7-b74f-44be-b7f8-11f04387d2d9 tempest-ProjectMemberTests-563779261 None] Lock "cinder-bde34743-516e-49df-befd-5d4761c095b5-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (fa5011d1-b67d-4100-9668-8b5a74bf7e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e218d105-e4b6-4e4e-82e2-d28e0e7912d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e218d105-e4b6-4e4e-82e2-d28e0e7912d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671838958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f94fb06-7ce6-45a1-bc6b-3b3b628be3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:44Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d7b22c-08c7-404a-abe5-cc61341413cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d7b22c-08c7-404a-abe5-cc61341413cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cdc7df-12f4-45f3-a7ae-0e2666472020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cdc7df-12f4-45f3-a7ae-0e2666472020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f94fb06-7ce6-45a1-bc6b-3b3b628be3da', 'volume_name': 'volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fe16c8-16a2-4fcf-8118-05ff8a4269b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56fe16c8-16a2-4fcf-8118-05ff8a4269b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92aa691-1e1f-4f06-b5c2-3a7fd8fb9ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:44 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Volume 9f94fb06-7ce6-45a1-bc6b-3b3b628be3da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da', 'volume_size': 1} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671838958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f94fb06-7ce6-45a1-bc6b-3b3b628be3da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:44Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Creating volume 9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:27:44 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:44 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da 1073741824 Sep 28 15:27:44 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:44 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:44 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da 1073741824" returned: 0 in 0.418s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:45 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da Sep 28 15:27:45 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:45 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" returned: 0 in 0.259s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92aa691-1e1f-4f06-b5c2-3a7fd8fb9ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849692ba-e0ae-40a6-a85a-55722d8befb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:45 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Volume volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da (9f94fb06-7ce6-45a1-bc6b-3b3b628be3da): created successfully Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849692ba-e0ae-40a6-a85a-55722d8befb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (fa5011d1-b67d-4100-9668-8b5a74bf7e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:45 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-643033a4-3be8-4fc5-919b-fe8c3d541f36 tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot 63214564-b986-4e6f-a18d-2aabd7034b6b of volume 9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0135e8cf-1faa-4a81-b8e2-3b5d1b569880]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:45 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:45 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da Sep 28 15:27:45 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:46 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" returned: 0 in 0.370s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:46 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b 1G Sep 28 15:27:46 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:46 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b 1G" returned: 0 in 0.399s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:46 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b Sep 28 15:27:46 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:46 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b" returned: 0 in 0.294s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:46 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b is being set with open permissions: ugo+rw Sep 28 15:27:46 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:46 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b Sep 28 15:27:46 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:46 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b" returned: 0 in 0.244s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:47 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.info Sep 28 15:27:47 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:47 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.info" returned: 0 in 0.278s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:47 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.info is being set with open permissions: ugo+rw Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:47 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:47 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:47 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.info Sep 28 15:27:47 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:47 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.274s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:27:47 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.info" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:47 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ed222109-169c-4903-94be-417a482a3021 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-63214564-b986-4e6f-a18d-2aabd7034b6b-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Lock "cinder-63214564-b986-4e6f-a18d-2aabd7034b6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-63214564-b986-4e6f-a18d-2aabd7034b6b" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-63214564-b986-4e6f-a18d-2aabd7034b6b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot 63214564-b986-4e6f-a18d-2aabd7034b6b of volume 9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e989d0-240b-4996-a254-24e9eeb17044]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:47 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b Sep 28 15:27:47 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:48 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b" returned: 0 in 0.393s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:48 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:48 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd6ff4-9a24-45b0-be61-33452c902ac9]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:48 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da Sep 28 15:27:48 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:48 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" returned: 0 in 0.396s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:48 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:48 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b Sep 28 15:27:48 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:49 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b" returned: 0 in 0.347s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:49 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b Sep 28 15:27:49 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:49 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da.63214564-b986-4e6f-a18d-2aabd7034b6b" returned: 0 in 0.257s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-63214564-b986-4e6f-a18d-2aabd7034b6b" released by "_delete_snapshot" :: held 1.496s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" released by "delete_snapshot" :: held 1.520s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Created reservations ['d8058111-6ec6-44b7-bce0-e693f2e4da3a', '4218ab34-1214-4594-bdef-626e588e716f', 'bf998e89-9d99-436d-b6da-c2528ea2874c', '0d1cddaf-2550-47c7-aafe-e1381acfccff'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:49 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-aa9d1a6a-12cb-41c4-99d9-8826185ac750 tempest-ProjectMemberTests-563779261 None] Lock "cinder-63214564-b986-4e6f-a18d-2aabd7034b6b-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:49 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Lock "cinder-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" acquired by "delete_volume" :: waited 0.013s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0480014-4faa-46c8-abb1-866abf875b00]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:50 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da Sep 28 15:27:50 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:50 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" returned: 0 in 0.347s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:50 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da Sep 28 15:27:50 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:50 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" returned: 0 in 0.233s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da" released by "delete_volume" :: held 0.643s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Created reservations ['82e80c2e-967c-449c-abe9-c3bd1df2e18b', 'a68f763f-0318-451b-9455-d4a0798f2769', '63562f0f-30cb-4fe3-8c1e-816ee93ca8b0', '9bb7c144-b690-40af-8876-78ac1e782a0f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:50 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:50 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:50 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:51 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.241s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:51 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-12ca230c-16f4-4c8c-ad2a-9da8c575a28c tempest-ProjectMemberTests-563779261 None] Lock "cinder-9f94fb06-7ce6-45a1-bc6b-3b3b628be3da-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (7fb2c8ed-1641-4a78-b337-180624e34ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9566cbb-7c65-4c8b-99ab-e4018ccea365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9566cbb-7c65-4c8b-99ab-e4018ccea365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996564433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6acb215-da46-45ab-9e46-35927b00323d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:51Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd04e26-6d85-4270-85b1-381325e941b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd04e26-6d85-4270-85b1-381325e941b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552534df-8608-4b5d-96b8-6f78296547f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552534df-8608-4b5d-96b8-6f78296547f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6acb215-da46-45ab-9e46-35927b00323d', 'volume_name': 'volume-c6acb215-da46-45ab-9e46-35927b00323d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c1d7a9-4492-4831-b9d4-60fcdff6d23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c1d7a9-4492-4831-b9d4-60fcdff6d23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a692c664-8e9c-4ed5-b5af-6a65517c0239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:51 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Volume c6acb215-da46-45ab-9e46-35927b00323d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6acb215-da46-45ab-9e46-35927b00323d', 'volume_size': 1} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-996564433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6acb215-da46-45ab-9e46-35927b00323d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7db2648834651b51ad4d9fdab9e2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:27:51Z,use_quota=True,user_id='04cae99a62bf4913b3f5a3c21bf73523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Creating volume c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:27:51 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:27:51 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:51 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d 1073741824 Sep 28 15:27:51 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:52 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d 1073741824" returned: 0 in 0.391s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:52 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d Sep 28 15:27:52 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:52 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d" returned: 0 in 0.242s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a692c664-8e9c-4ed5-b5af-6a65517c0239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6acb215-da46-45ab-9e46-35927b00323d', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cca96fc-6ada-4c69-a877-452dfdb05b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:27:52 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Volume volume-c6acb215-da46-45ab-9e46-35927b00323d (c6acb215-da46-45ab-9e46-35927b00323d): created successfully Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cca96fc-6ada-4c69-a877-452dfdb05b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Flow 'volume_create_manager' (7fb2c8ed-1641-4a78-b337-180624e34ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:27:52 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-73c5047a-2293-4e98-97e3-e7022ca3674f tempest-ProjectMemberTests-563779261 None] Created volume successfully. Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Creating offline snapshot 5616df0b-5134-479d-9090-891cdef48e6a of volume c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[356dd4b3-ae2d-4e10-8d64-d9cb684c0384]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:52 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:52 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d Sep 28 15:27:52 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:53 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d" returned: 0 in 0.361s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:53 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a 1G Sep 28 15:27:53 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:53 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a 1G" returned: 0 in 0.381s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6acb215-da46-45ab-9e46-35927b00323d -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:53 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6acb215-da46-45ab-9e46-35927b00323d -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a Sep 28 15:27:53 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:53 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6acb215-da46-45ab-9e46-35927b00323d -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a" returned: 0 in 0.284s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:53 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a is being set with open permissions: ugo+rw Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:53 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a Sep 28 15:27:53 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:53 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a" returned: 0 in 0.230s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:53 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:54 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.info Sep 28 15:27:54 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:54 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.info" returned: 0 in 0.241s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:54 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.info is being set with open permissions: ugo+rw Sep 28 15:27:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:54 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.info Sep 28 15:27:54 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:54 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.info" returned: 0 in 0.233s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:54 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-dc682242-7b55-408b-9f83-d3d2a2c13b66 tempest-ProjectMemberTests-563779261 None] Create snapshot completed successfully Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-5616df0b-5134-479d-9090-891cdef48e6a-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Lock "cinder-5616df0b-5134-479d-9090-891cdef48e6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-c6acb215-da46-45ab-9e46-35927b00323d" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-c6acb215-da46-45ab-9e46-35927b00323d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-5616df0b-5134-479d-9090-891cdef48e6a" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-5616df0b-5134-479d-9090-891cdef48e6a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Deleting offline snapshot 5616df0b-5134-479d-9090-891cdef48e6a of volume c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] snapshot_file for this snap is: volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[329422d3-d71f-41d6-a97f-a63a1a35e8dc]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:55 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a Sep 28 15:27:55 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:55 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a" returned: 0 in 0.346s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6acb215-da46-45ab-9e46-35927b00323d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2c7a9-e2cd-4625-a923-69fa642cef06]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:55 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d Sep 28 15:27:55 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:55 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d" returned: 0 in 0.330s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:55 devstack sudo[109096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a Sep 28 15:27:55 devstack sudo[109096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:56 devstack sudo[109096]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a" returned: 0 in 0.344s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:56 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a Sep 28 15:27:56 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:56 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d.5616df0b-5134-479d-9090-891cdef48e6a" returned: 0 in 0.230s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-5616df0b-5134-479d-9090-891cdef48e6a" released by "_delete_snapshot" :: held 1.348s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-c6acb215-da46-45ab-9e46-35927b00323d" released by "delete_snapshot" :: held 1.373s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Created reservations ['651314af-bd32-46f3-8587-127ccb9a5fe6', 'dd91063e-2c2d-48a8-b073-4e0924a090df', 'cf2b00be-19ef-4ba5-a126-7176482ac884', '61888616-cbf0-4878-add2-d43f2c2c8509'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Delete snapshot completed successfully. Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-5c9fca27-480c-4587-9ce7-9b3c2b69de58 tempest-ProjectMemberTests-563779261 None] Lock "cinder-5616df0b-5134-479d-9090-891cdef48e6a-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-c6acb215-da46-45ab-9e46-35927b00323d-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Lock "cinder-c6acb215-da46-45ab-9e46-35927b00323d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Acquiring lock "cinder-quobyte-c6acb215-da46-45ab-9e46-35927b00323d" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-c6acb215-da46-45ab-9e46-35927b00323d" acquired by "delete_volume" :: waited 0.012s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[76817ae3-3553-4c79-8494-7604bfd9d437]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:57 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d Sep 28 15:27:57 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:57 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d" returned: 0 in 0.360s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:57 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d Sep 28 15:27:57 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:58 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-c6acb215-da46-45ab-9e46-35927b00323d" returned: 0 in 0.257s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Lock "cinder-quobyte-c6acb215-da46-45ab-9e46-35927b00323d" released by "delete_volume" :: held 0.676s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Created reservations ['8caadcbf-b8d2-46bb-bc3d-f9029ac69c2c', '3f2b3140-879a-48d7-a4a1-d7db91dac4da', '0b80ace7-9a88-4eb7-aa5f-f120678fb2b8', 'a5103a6d-6109-437b-a7cb-47d31d08e80a'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:27:58 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:27:58 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:27:58 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.256s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:27:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Deleted volume successfully. Sep 28 15:27:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-ceb9bf72-85fc-4938-ae9b-05b15dac1568 tempest-ProjectMemberTests-563779261 None] Lock "cinder-c6acb215-da46-45ab-9e46-35927b00323d-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (425b6f5d-48e3-4123-bb48-34ba2588a693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eb7458-64af-4186-8551-7435f4acdc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72eb7458-64af-4186-8551-7435f4acdc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113282682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca86ca17-d4b7-4237-8161-f99c875348b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:03Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20847adb-5074-4aac-8647-9b85d0c615dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20847adb-5074-4aac-8647-9b85d0c615dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177a41a8-8c47-428c-b089-4d07d25c78b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177a41a8-8c47-428c-b089-4d07d25c78b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca86ca17-d4b7-4237-8161-f99c875348b1', 'volume_name': 'volume-ca86ca17-d4b7-4237-8161-f99c875348b1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40faf2f-6270-48fe-93b6-a43289eb8c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40faf2f-6270-48fe-93b6-a43289eb8c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b81d5b7-99e7-4dbd-b0f7-5f74822356ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Volume ca86ca17-d4b7-4237-8161-f99c875348b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca86ca17-d4b7-4237-8161-f99c875348b1', 'volume_size': 1} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113282682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca86ca17-d4b7-4237-8161-f99c875348b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:03Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Creating volume ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:28:02 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:28:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:02 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 1073741824 Sep 28 15:28:02 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:03 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 1073741824" returned: 0 in 0.433s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:03 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 Sep 28 15:28:03 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:03 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1" returned: 0 in 0.265s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b81d5b7-99e7-4dbd-b0f7-5f74822356ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca86ca17-d4b7-4237-8161-f99c875348b1', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf7df50-cbb3-43a5-bc7e-f9398dc37713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:03 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Volume volume-ca86ca17-d4b7-4237-8161-f99c875348b1 (ca86ca17-d4b7-4237-8161-f99c875348b1): created successfully Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf7df50-cbb3-43a5-bc7e-f9398dc37713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (425b6f5d-48e3-4123-bb48-34ba2588a693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-65f15695-cca7-4c95-920d-b44177608b9a tempest-ProjectReaderTests-1403619752 None] Created volume successfully. Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Creating offline snapshot be58417c-b934-4dbc-a4ad-fe43466bfa38 of volume ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6f62b5-8613-40ad-ac7f-5e0ce7711fb8]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:04 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 Sep 28 15:28:04 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:04 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1" returned: 0 in 0.357s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:04 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 1G Sep 28 15:28:04 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:04 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 1G" returned: 0 in 0.383s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca86ca17-d4b7-4237-8161-f99c875348b1 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:04 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca86ca17-d4b7-4237-8161-f99c875348b1 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 Sep 28 15:28:04 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:04 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca86ca17-d4b7-4237-8161-f99c875348b1 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38" returned: 0 in 0.285s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:04 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 is being set with open permissions: ugo+rw Sep 28 15:28:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:04 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 Sep 28 15:28:04 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:05 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38" returned: 0 in 0.233s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:05 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.info Sep 28 15:28:05 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:05 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.info" returned: 0 in 0.250s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:05 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.info is being set with open permissions: ugo+rw Sep 28 15:28:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:05 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.info Sep 28 15:28:05 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:05 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.info" returned: 0 in 0.252s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:05 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:05 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-cf72c95b-f35d-4a33-9c4c-d3112fd78f13 tempest-ProjectReaderTests-1403619752 None] Create snapshot completed successfully Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-be58417c-b934-4dbc-a4ad-fe43466bfa38-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-be58417c-b934-4dbc-a4ad-fe43466bfa38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-ca86ca17-d4b7-4237-8161-f99c875348b1" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-ca86ca17-d4b7-4237-8161-f99c875348b1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-be58417c-b934-4dbc-a4ad-fe43466bfa38" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-be58417c-b934-4dbc-a4ad-fe43466bfa38" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Deleting offline snapshot be58417c-b934-4dbc-a4ad-fe43466bfa38 of volume ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] snapshot_file for this snap is: volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b057101-33ba-4200-b2d9-198bb47dfe66]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:06 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 Sep 28 15:28:06 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:06 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38" returned: 0 in 0.394s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca86ca17-d4b7-4237-8161-f99c875348b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dbe81b-9b6c-47c5-b712-b0661fd049de]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:06 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:06 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 Sep 28 15:28:06 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:07 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1" returned: 0 in 0.436s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:07 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 Sep 28 15:28:07 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:07 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38" returned: 0 in 0.355s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:07 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38 Sep 28 15:28:07 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:07 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1.be58417c-b934-4dbc-a4ad-fe43466bfa38" returned: 0 in 0.260s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-be58417c-b934-4dbc-a4ad-fe43466bfa38" released by "_delete_snapshot" :: held 1.557s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-ca86ca17-d4b7-4237-8161-f99c875348b1" released by "delete_snapshot" :: held 1.579s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Created reservations ['9d9099e2-7250-429d-95e7-c7fde875bf89', 'eab2bcde-a7ba-4fda-b99d-abdd48655e3c', 'ffa02f3f-6cd2-4d30-9059-b8bdd31f53b0', '33040b60-71d7-40f3-a0f9-7dbc40e026bb'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:07 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Delete snapshot completed successfully. Sep 28 15:28:07 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-11c25528-8f62-417a-9f03-f96dbd60247a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-be58417c-b934-4dbc-a4ad-fe43466bfa38-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-ca86ca17-d4b7-4237-8161-f99c875348b1-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-ca86ca17-d4b7-4237-8161-f99c875348b1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-ca86ca17-d4b7-4237-8161-f99c875348b1" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-ca86ca17-d4b7-4237-8161-f99c875348b1" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cacb01-d10a-4656-ab8a-f267626da833]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:08 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 Sep 28 15:28:08 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:08 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1" returned: 0 in 0.393s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:08 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:08 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1 Sep 28 15:28:08 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:09 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-ca86ca17-d4b7-4237-8161-f99c875348b1" returned: 0 in 0.275s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-ca86ca17-d4b7-4237-8161-f99c875348b1" released by "delete_volume" :: held 0.735s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Created reservations ['71f2ab08-39ec-4f8b-ae06-d4d5856ae2bd', '53fe68ac-6ae7-49c6-af71-b0aaecaa7a31', 'c8f5f2f3-553c-4a0d-a19e-0c3144f2c740', 'aa959ea4-e0f3-4cca-a524-d735431a1662'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:09 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:09 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:09 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.272s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:09 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Deleted volume successfully. Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-23e0515c-3ba1-4cc2-932f-aa876e8cf9e3 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-ca86ca17-d4b7-4237-8161-f99c875348b1-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (03ebd9d5-fd7f-4cd1-a2e8-e5ae37d5bdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3146edf-af18-45f1-8361-480f2cf9f74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3146edf-af18-45f1-8361-480f2cf9f74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-446549523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54071c37-226f-4384-a686-5b34c545b3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:10Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9022ff4-e94a-4fcb-84c2-22bc9a7f366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9022ff4-e94a-4fcb-84c2-22bc9a7f366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f5fb9-9cd3-443e-ba20-c497eb819ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f5fb9-9cd3-443e-ba20-c497eb819ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54071c37-226f-4384-a686-5b34c545b3b9', 'volume_name': 'volume-54071c37-226f-4384-a686-5b34c545b3b9', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2523e380-81a0-4a67-9696-e270ddc249ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:09 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2523e380-81a0-4a67-9696-e270ddc249ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6b2d18-3f5d-4c42-8ed5-5ecd85e9f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:10 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Volume 54071c37-226f-4384-a686-5b34c545b3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54071c37-226f-4384-a686-5b34c545b3b9', 'volume_size': 1} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-446549523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54071c37-226f-4384-a686-5b34c545b3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:10Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Creating volume 54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:28:10 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:10 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 1073741824 Sep 28 15:28:10 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:10 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 1073741824" returned: 0 in 0.419s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:10 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 Sep 28 15:28:10 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:10 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9" returned: 0 in 0.242s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6b2d18-3f5d-4c42-8ed5-5ecd85e9f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54071c37-226f-4384-a686-5b34c545b3b9', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95d9990-21e0-488b-99ff-e70107d99db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:10 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Volume volume-54071c37-226f-4384-a686-5b34c545b3b9 (54071c37-226f-4384-a686-5b34c545b3b9): created successfully Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95d9990-21e0-488b-99ff-e70107d99db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:10 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (03ebd9d5-fd7f-4cd1-a2e8-e5ae37d5bdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:10 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-845bafe7-3f8d-4da5-ba78-b69490f90641 tempest-ProjectReaderTests-1403619752 None] Created volume successfully. Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Creating offline snapshot 64123ec4-065f-445b-935e-a42a37634cd4 of volume 54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb4ae5f-2f28-45e5-a560-e278a52fc835]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:11 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 Sep 28 15:28:11 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:11 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9" returned: 0 in 0.373s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:11 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 1G Sep 28 15:28:11 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:11 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 1G" returned: 0 in 0.397s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:11 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54071c37-226f-4384-a686-5b34c545b3b9 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:11 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54071c37-226f-4384-a686-5b34c545b3b9 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 Sep 28 15:28:11 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:12 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54071c37-226f-4384-a686-5b34c545b3b9 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4" returned: 0 in 0.299s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:12 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 is being set with open permissions: ugo+rw Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:12 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 Sep 28 15:28:12 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:12 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4" returned: 0 in 0.242s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:12 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.info Sep 28 15:28:12 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:12 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.info" returned: 0 in 0.246s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:12 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.info is being set with open permissions: ugo+rw Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:12 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.info Sep 28 15:28:12 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:12 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.info" returned: 0 in 0.258s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:12 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:13 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-e8ebf895-9d8f-4a10-aa53-94557ef45e09 tempest-ProjectReaderTests-1403619752 None] Create snapshot completed successfully Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-64123ec4-065f-445b-935e-a42a37634cd4-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-64123ec4-065f-445b-935e-a42a37634cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-54071c37-226f-4384-a686-5b34c545b3b9" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-54071c37-226f-4384-a686-5b34c545b3b9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-64123ec4-065f-445b-935e-a42a37634cd4" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-64123ec4-065f-445b-935e-a42a37634cd4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Deleting offline snapshot 64123ec4-065f-445b-935e-a42a37634cd4 of volume 54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] snapshot_file for this snap is: volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f307cec-1fa7-4dc4-877b-7a0446d62b42]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:13 devstack sudo[109213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 Sep 28 15:28:13 devstack sudo[109213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:13 devstack sudo[109213]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4" returned: 0 in 0.363s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54071c37-226f-4384-a686-5b34c545b3b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabb9459-f40a-4914-ae34-f8dc1f79d99f]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:13 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:13 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 Sep 28 15:28:13 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:14 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9" returned: 0 in 0.356s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:14 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 Sep 28 15:28:14 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:14 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4" returned: 0 in 0.336s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:14 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4 Sep 28 15:28:14 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:14 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9.64123ec4-065f-445b-935e-a42a37634cd4" returned: 0 in 0.242s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-64123ec4-065f-445b-935e-a42a37634cd4" released by "_delete_snapshot" :: held 1.405s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-54071c37-226f-4384-a686-5b34c545b3b9" released by "delete_snapshot" :: held 1.429s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Created reservations ['d4d529d1-49fc-4a80-ac0c-40ef45960784', 'f7ac5c5d-7994-44ed-8211-898eacde64b1', 'd967be1e-99de-4424-a744-af7729a5b2bc', '5394c9c5-0cc7-4ea4-b2a9-5b0a2bb0c740'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:14 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Delete snapshot completed successfully. Sep 28 15:28:14 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b17c0786-07b4-4405-9be0-e6b1bb464059 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-64123ec4-065f-445b-935e-a42a37634cd4-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-54071c37-226f-4384-a686-5b34c545b3b9-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-54071c37-226f-4384-a686-5b34c545b3b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-54071c37-226f-4384-a686-5b34c545b3b9" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-54071c37-226f-4384-a686-5b34c545b3b9" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a5037-c8d8-4d33-b254-e51fa6e1aa7d]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:15 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 Sep 28 15:28:15 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:15 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9" returned: 0 in 0.361s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:15 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:15 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9 Sep 28 15:28:15 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:16 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-54071c37-226f-4384-a686-5b34c545b3b9" returned: 0 in 0.256s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-54071c37-226f-4384-a686-5b34c545b3b9" released by "delete_volume" :: held 0.682s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Created reservations ['f13149a1-60fd-4ed4-9475-4cf506fbb2d5', '1cc72c7c-72d0-4d09-8f94-b2129d66e02b', '54c451ff-a4be-4f30-8a34-2b2a0041a9ba', 'e3a5e5c3-ed1c-4ff3-8a2c-d8ae25c217e2'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:16 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:16 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:16 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.245s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:16 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Deleted volume successfully. Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-6be85bbe-c3ea-4e22-b871-e484c3eb7849 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-54071c37-226f-4384-a686-5b34c545b3b9-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (e4a20314-5525-494b-84d9-bdc266e4fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7607b386-3bca-40d9-a62e-6ec1fa9c04db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7607b386-3bca-40d9-a62e-6ec1fa9c04db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742244462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859b6e3b-7c53-427e-95fb-4220f1d2183c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:17Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:16 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0da27e7-5959-45ba-a97a-669f67ad30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0da27e7-5959-45ba-a97a-669f67ad30d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9e02b9-b8e5-4914-aa08-cf0414f3f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9e02b9-b8e5-4914-aa08-cf0414f3f316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859b6e3b-7c53-427e-95fb-4220f1d2183c', 'volume_name': 'volume-859b6e3b-7c53-427e-95fb-4220f1d2183c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb25e6e0-4330-4bb2-9b67-940055d8a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb25e6e0-4330-4bb2-9b67-940055d8a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff85fb2-72a9-4349-b7e7-bdd927e2590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:17 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Volume 859b6e3b-7c53-427e-95fb-4220f1d2183c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859b6e3b-7c53-427e-95fb-4220f1d2183c', 'volume_size': 1} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-742244462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859b6e3b-7c53-427e-95fb-4220f1d2183c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:17Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Creating volume 859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:28:17 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:17 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c 1073741824 Sep 28 15:28:17 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:17 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c 1073741824" returned: 0 in 0.415s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:17 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c Sep 28 15:28:17 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:17 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c" returned: 0 in 0.235s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff85fb2-72a9-4349-b7e7-bdd927e2590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859b6e3b-7c53-427e-95fb-4220f1d2183c', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248612c0-806b-42f6-9386-79621cb8a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:17 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Volume volume-859b6e3b-7c53-427e-95fb-4220f1d2183c (859b6e3b-7c53-427e-95fb-4220f1d2183c): created successfully Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (248612c0-806b-42f6-9386-79621cb8a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:17 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (e4a20314-5525-494b-84d9-bdc266e4fd01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:17 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a38fcb8f-6822-498c-a836-17ea1df1bda6 tempest-ProjectReaderTests-1403619752 None] Created volume successfully. Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Creating offline snapshot 6a86f5dd-87ec-4456-a79a-c540b1de8c02 of volume 859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbb07eb-ab3a-4f26-ba68-40ebc8edbbf5]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:18 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c Sep 28 15:28:18 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:18 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c" returned: 0 in 0.355s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:18 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 1G Sep 28 15:28:18 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:18 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 1G" returned: 0 in 0.385s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:18 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859b6e3b-7c53-427e-95fb-4220f1d2183c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:18 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859b6e3b-7c53-427e-95fb-4220f1d2183c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 Sep 28 15:28:18 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:19 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859b6e3b-7c53-427e-95fb-4220f1d2183c -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02" returned: 0 in 0.292s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:19 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 is being set with open permissions: ugo+rw Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:19 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 Sep 28 15:28:19 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:19 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02" returned: 0 in 0.238s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:19 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.info Sep 28 15:28:19 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:19 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.info" returned: 0 in 0.258s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:19 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.info is being set with open permissions: ugo+rw Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:19 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.info Sep 28 15:28:19 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:19 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.info" returned: 0 in 0.227s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:19 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:20 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-bc88f83c-68a8-4ab6-9917-e89c4a954de1 tempest-ProjectReaderTests-1403619752 None] Create snapshot completed successfully Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-6a86f5dd-87ec-4456-a79a-c540b1de8c02-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Lock "cinder-6a86f5dd-87ec-4456-a79a-c540b1de8c02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-859b6e3b-7c53-427e-95fb-4220f1d2183c" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-859b6e3b-7c53-427e-95fb-4220f1d2183c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-6a86f5dd-87ec-4456-a79a-c540b1de8c02" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-6a86f5dd-87ec-4456-a79a-c540b1de8c02" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Deleting offline snapshot 6a86f5dd-87ec-4456-a79a-c540b1de8c02 of volume 859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] snapshot_file for this snap is: volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ee76fc-4207-4e49-b9cd-42208be39e0b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:20 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 Sep 28 15:28:20 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:20 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02" returned: 0 in 0.343s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-859b6e3b-7c53-427e-95fb-4220f1d2183c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34cc0a9-8874-4d6d-963b-e3089d9b2773]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:20 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:20 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c Sep 28 15:28:20 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:21 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c" returned: 0 in 0.350s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:21 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 Sep 28 15:28:21 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:21 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02" returned: 0 in 0.343s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:21 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02 Sep 28 15:28:21 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:21 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c.6a86f5dd-87ec-4456-a79a-c540b1de8c02" returned: 0 in 0.245s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-6a86f5dd-87ec-4456-a79a-c540b1de8c02" released by "_delete_snapshot" :: held 1.377s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-859b6e3b-7c53-427e-95fb-4220f1d2183c" released by "delete_snapshot" :: held 1.397s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Created reservations ['b2f1901b-6f6a-4960-806b-ec3bf13eb797', 'd2a1e8bc-c4da-4722-8377-231e964213e9', '63843bc7-41be-411c-b53c-73bc8274d36d', '191ed002-f378-4328-8646-e524e88b074f'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:21 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Delete snapshot completed successfully. Sep 28 15:28:21 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b3337aeb-636d-4243-84c4-8d70d8fb3abf tempest-ProjectReaderTests-1403619752 None] Lock "cinder-6a86f5dd-87ec-4456-a79a-c540b1de8c02-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-859b6e3b-7c53-427e-95fb-4220f1d2183c-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-859b6e3b-7c53-427e-95fb-4220f1d2183c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-859b6e3b-7c53-427e-95fb-4220f1d2183c" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-859b6e3b-7c53-427e-95fb-4220f1d2183c" acquired by "delete_volume" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68b2957-0c50-4d75-8ca5-3586a2e2a00a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:22 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c Sep 28 15:28:22 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:22 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c" returned: 0 in 0.343s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:22 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:22 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c Sep 28 15:28:22 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:23 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-859b6e3b-7c53-427e-95fb-4220f1d2183c" returned: 0 in 0.242s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-859b6e3b-7c53-427e-95fb-4220f1d2183c" released by "delete_volume" :: held 0.647s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Created reservations ['0c23aa27-9a05-4677-baad-8338c3376019', '84e92829-b172-4d3d-8a0d-9a64bd2c298f', '5ece9f4a-b859-4ae1-85ee-9f1968def705', '0ccf5de3-b609-4b00-aff4-117b9f558de1'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:23 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:23 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:23 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.247s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:23 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Deleted volume successfully. Sep 28 15:28:23 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-680f4add-b6e6-40e5-8ee9-29d0547de41a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-859b6e3b-7c53-427e-95fb-4220f1d2183c-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (d3f570a4-0773-480a-8b23-fe2c3466aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f7e57d-bd56-443a-b356-75af8bcf0df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f7e57d-bd56-443a-b356-75af8bcf0df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064023484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83947f84-5f35-4eef-bc6d-9b9f2d1acbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:24Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223be329-187d-438c-a4d9-7fa565f663f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223be329-187d-438c-a4d9-7fa565f663f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d88d5b-a65e-4dd5-bda0-344bfe644ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d88d5b-a65e-4dd5-bda0-344bfe644ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83947f84-5f35-4eef-bc6d-9b9f2d1acbc7', 'volume_name': 'volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f18388c-bc9a-4603-be24-500f296d4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f18388c-bc9a-4603-be24-500f296d4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a23ade3-83d3-451b-ad83-032cdc2f40b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Volume 83947f84-5f35-4eef-bc6d-9b9f2d1acbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7', 'volume_size': 1} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064023484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83947f84-5f35-4eef-bc6d-9b9f2d1acbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:24Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Creating volume 83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:28:24 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:24 devstack sudo[109312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 1073741824 Sep 28 15:28:24 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:24 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 1073741824" returned: 0 in 0.440s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:24 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 Sep 28 15:28:24 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:24 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" returned: 0 in 0.241s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a23ade3-83d3-451b-ad83-032cdc2f40b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db42adeb-789c-44d6-82af-e0bb497def66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:24 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Volume volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 (83947f84-5f35-4eef-bc6d-9b9f2d1acbc7): created successfully Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db42adeb-789c-44d6-82af-e0bb497def66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:24 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (d3f570a4-0773-480a-8b23-fe2c3466aacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:24 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b0f4e46c-368a-44d4-86bb-3f3186636127 tempest-ProjectReaderTests-1403619752 None] Created volume successfully. Sep 28 15:28:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:25 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Creating offline snapshot db26a6b7-48b3-409e-9888-df980fdd09c6 of volume 83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:28:25 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[497beffd-0dc1-4f89-9266-40156aa8805b]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:25 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 Sep 28 15:28:25 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:25 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" returned: 0 in 0.360s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:25 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:25 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 1G Sep 28 15:28:25 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:26 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 1G" returned: 0 in 0.395s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:26 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 Sep 28 15:28:26 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:26 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6" returned: 0 in 0.291s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:26 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 is being set with open permissions: ugo+rw Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:26 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 Sep 28 15:28:26 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:26 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6" returned: 0 in 0.247s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:26 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.info Sep 28 15:28:26 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:26 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.info" returned: 0 in 0.249s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:26 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.info is being set with open permissions: ugo+rw Sep 28 15:28:26 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:26 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.info Sep 28 15:28:26 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:27 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.info" returned: 0 in 0.248s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:27 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-0bc90292-9449-488f-8b37-db2ef76555b9 tempest-ProjectReaderTests-1403619752 None] Create snapshot completed successfully Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-db26a6b7-48b3-409e-9888-df980fdd09c6-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-db26a6b7-48b3-409e-9888-df980fdd09c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-db26a6b7-48b3-409e-9888-df980fdd09c6" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-db26a6b7-48b3-409e-9888-df980fdd09c6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Deleting offline snapshot db26a6b7-48b3-409e-9888-df980fdd09c6 of volume 83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] snapshot_file for this snap is: volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[b990a525-a5a5-43e0-904b-28aedb8aa392]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:27 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 Sep 28 15:28:27 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:27 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6" returned: 0 in 0.379s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[40553bf4-adc2-4f1b-9088-7a5c300380fc]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:27 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:28 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 Sep 28 15:28:28 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:28 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" returned: 0 in 0.366s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:28 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 Sep 28 15:28:28 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:28 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6" returned: 0 in 0.345s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:28 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6 Sep 28 15:28:28 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:28 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7.db26a6b7-48b3-409e-9888-df980fdd09c6" returned: 0 in 0.265s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-db26a6b7-48b3-409e-9888-df980fdd09c6" released by "_delete_snapshot" :: held 1.459s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" released by "delete_snapshot" :: held 1.483s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:INSERT=42,cinder:UPDATE=135,cinder:SELECT=116,cinder:DELETE=11 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=108,cinder:INSERT=38,cinder:UPDATE=153,cinder:DELETE=13 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:28:28 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Created reservations ['78f290c0-9f4a-4764-9ba6-49ff259c83c7', '6951ed8c-9ae6-4dbd-9ac6-b64ef5b59f69', '43061f16-c97d-4777-bb6e-35569b17cb4e', '85e8a936-23f1-4815-9778-839d41792d96'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:29 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Delete snapshot completed successfully. Sep 28 15:28:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b78abc73-66fd-435e-bd68-1c933003fd9a tempest-ProjectReaderTests-1403619752 None] Lock "cinder-db26a6b7-48b3-409e-9888-df980fdd09c6-delete_snapshot" released by "delete_snapshot" :: held 1.627s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:29 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" acquired by "delete_volume" :: waited 0.021s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:29 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[09127bd0-e76d-495f-b753-8b8aaa306acf]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:29 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:29 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 Sep 28 15:28:29 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:30 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" returned: 0 in 0.357s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:30 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7 Sep 28 15:28:30 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:30 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" returned: 0 in 0.240s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7" released by "delete_volume" :: held 0.658s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Created reservations ['33948dbc-6c6c-4ca7-aecf-bad7edab445f', '09be1b81-9f15-4610-b1f1-f915c4041ad5', 'fc3b88bf-4802-469b-a85a-290105c76750', 'ae60e50b-f0c3-48f2-a101-bd29047109fc'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:30 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:30 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:30 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.273s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:30 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Deleted volume successfully. Sep 28 15:28:30 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-85d11223-29d1-4e31-8662-941d65e387a5 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-83947f84-5f35-4eef-bc6d-9b9f2d1acbc7-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (abc438c7-9842-4694-b272-6427db2d2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae43f8-416c-4bbe-a474-52cf2514b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae43f8-416c-4bbe-a474-52cf2514b07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339533592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017b32f9-fff7-41d9-8a59-bdf7d36a11ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:31Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bd1dff-32e0-4bd8-94bc-3ad0a8162e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bd1dff-32e0-4bd8-94bc-3ad0a8162e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c224580-f932-406a-bb5d-db149686a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c224580-f932-406a-bb5d-db149686a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017b32f9-fff7-41d9-8a59-bdf7d36a11ae', 'volume_name': 'volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7beba113-ce72-4bbd-8861-7492b434fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7beba113-ce72-4bbd-8861-7492b434fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a0476f-06ef-4416-a12a-ff0c2c6ba96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:31 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Volume 017b32f9-fff7-41d9-8a59-bdf7d36a11ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae', 'volume_size': 1} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339533592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017b32f9-fff7-41d9-8a59-bdf7d36a11ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b592dd98895045eab77e749ab7d4e8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:31Z,use_quota=True,user_id='8adbbca96cff4211a8aa7307c6d2ee98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Creating volume 017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:28:31 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:31 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae 1073741824 Sep 28 15:28:31 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:31 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae 1073741824" returned: 0 in 0.453s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:31 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:31 devstack sudo[109380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae Sep 28 15:28:31 devstack sudo[109380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:32 devstack sudo[109380]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" returned: 0 in 0.248s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a0476f-06ef-4416-a12a-ff0c2c6ba96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68d05dd-ff14-4f5b-a5ee-372ef3b47032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:32 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Volume volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae (017b32f9-fff7-41d9-8a59-bdf7d36a11ae): created successfully Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68d05dd-ff14-4f5b-a5ee-372ef3b47032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Flow 'volume_create_manager' (abc438c7-9842-4694-b272-6427db2d2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:32 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7f3e1e60-744c-48d1-b22e-b922f4c92ff3 tempest-ProjectReaderTests-1403619752 None] Created volume successfully. Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Creating offline snapshot 4ddad839-0fb6-41ad-9bf8-8bf151654c4f of volume 017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e047e0-db2c-48d6-9bca-8f8a20b94065]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:32 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae Sep 28 15:28:32 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:32 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" returned: 0 in 0.369s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:32 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f 1G {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:32 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f 1G Sep 28 15:28:32 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:33 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f 1G" returned: 0 in 0.396s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:33 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f Sep 28 15:28:33 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:33 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae -F qcow2 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f" returned: 0 in 0.301s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:33 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f is being set with open permissions: ugo+rw Sep 28 15:28:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:33 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f Sep 28 15:28:33 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:33 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f" returned: 0 in 0.233s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:33 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:33 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.info Sep 28 15:28:33 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:34 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.info" returned: 0 in 0.261s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:34 devstack cinder-volume[86301]: WARNING cinder.volume.drivers.remotefs [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.info is being set with open permissions: ugo+rw Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.info {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:34 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.info Sep 28 15:28:34 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:34 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.info" returned: 0 in 0.246s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:34 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-a87e2b7f-54a1-4ff3-bd70-3ea4ca960a61 tempest-ProjectReaderTests-1403619752 None] Create snapshot completed successfully Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-4ddad839-0fb6-41ad-9bf8-8bf151654c4f-delete_snapshot" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-4ddad839-0fb6-41ad-9bf8-8bf151654c4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" by "delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-4ddad839-0fb6-41ad-9bf8-8bf151654c4f" by "_delete_snapshot" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-4ddad839-0fb6-41ad-9bf8-8bf151654c4f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Deleting offline snapshot 4ddad839-0fb6-41ad-9bf8-8bf151654c4f of volume 017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] snapshot_file for this snap is: volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f {{(pid=86301) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8f030-4d82-4f50-9fc1-83813f18777a]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:34 devstack sudo[109407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f Sep 28 15:28:34 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:34 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f" returned: 0 in 0.342s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:34 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86301) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9de69a-ab91-4cdd-a2ab-66511cf30074]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:35 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae Sep 28 15:28:35 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:35 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" returned: 0 in 0.346s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:35 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f Sep 28 15:28:35 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:35 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f" returned: 0 in 0.320s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:35 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f Sep 28 15:28:35 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:35 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae.4ddad839-0fb6-41ad-9bf8-8bf151654c4f" returned: 0 in 0.235s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-4ddad839-0fb6-41ad-9bf8-8bf151654c4f" released by "_delete_snapshot" :: held 1.344s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:35 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" released by "delete_snapshot" :: held 1.367s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Created reservations ['8fb12fc7-f5f3-4c6b-9cd7-01f2c47de877', 'bc2a4e5e-0474-43cc-b499-8e67fd7d99c2', 'cf5b8b7b-88fc-4b87-9c5f-2aa81b11aff3', '1a34ef51-0c7d-4bc7-8e85-0c20432737e5'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:36 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Delete snapshot completed successfully. Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-b431ef7a-7b07-4c0d-a78b-d6c7c0113f17 tempest-ProjectReaderTests-1403619752 None] Lock "cinder-4ddad839-0fb6-41ad-9bf8-8bf151654c4f-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-017b32f9-fff7-41d9-8a59-bdf7d36a11ae-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Lock "cinder-017b32f9-fff7-41d9-8a59-bdf7d36a11ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Acquiring lock "cinder-quobyte-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92257d-a1d0-4c7b-ae8c-254a1b8ae4c1]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:36 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:36 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae Sep 28 15:28:36 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:37 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" returned: 0 in 0.363s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:37 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae Sep 28 15:28:37 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:37 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" returned: 0 in 0.245s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Lock "cinder-quobyte-017b32f9-fff7-41d9-8a59-bdf7d36a11ae" released by "delete_volume" :: held 0.668s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Created reservations ['5a18dd1c-258f-4619-9397-319f1a49f2aa', 'ca7b32c8-b271-427b-a0f1-2de4bf4ca4f5', '7cfe81c5-754d-435a-9d78-7e06c35c17a5', '9b6619ae-8f51-44fc-b328-f01b3f63f737'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:37 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:37 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:37 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.297s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:37 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Deleted volume successfully. Sep 28 15:28:37 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-929a9325-a1d7-4f8a-af22-a23f4356952f tempest-ProjectReaderTests-1403619752 None] Lock "cinder-017b32f9-fff7-41d9-8a59-bdf7d36a11ae-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:47 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:47 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:47 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.266s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG oslo_service.periodic_task [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] Running periodic task VolumeManager._thread_info {{(pid=86301) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread count: 28 {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f551e153-39db-4f50-a9be-a02a6ef07cb4 None None] thread info: [<_MainThread(MainThread, started 130760191008896)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86301) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:28:47 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=26,cinder:INSERT=11,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:28:48 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:INSERT=7,cinder:UPDATE=31,cinder:SELECT=20,cinder:DELETE=3 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (ccfd01ed-3c99-4e87-89f2-40f38a783f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6047785-35bb-4656-8959-25c82c18a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6047785-35bb-4656-8959-25c82c18a46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420291919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e926e2f7-1e26-4dae-a19a-38021441b01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:55Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafb65dc-44db-4439-abb0-197fed70f775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafb65dc-44db-4439-abb0-197fed70f775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6b32aa-b1d8-472e-aaba-b06a9cefef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6b32aa-b1d8-472e-aaba-b06a9cefef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e926e2f7-1e26-4dae-a19a-38021441b01a', 'volume_name': 'volume-e926e2f7-1e26-4dae-a19a-38021441b01a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930c502-da9a-4215-bf7b-9599bfc92cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930c502-da9a-4215-bf7b-9599bfc92cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c86ec40-ba6d-4d49-999e-caed2a5fbd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:54 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Volume e926e2f7-1e26-4dae-a19a-38021441b01a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e926e2f7-1e26-4dae-a19a-38021441b01a', 'volume_size': 1} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420291919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e926e2f7-1e26-4dae-a19a-38021441b01a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:55Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Creating volume e926e2f7-1e26-4dae-a19a-38021441b01a {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:28:54 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:28:54 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:54 devstack sudo[109481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a 1073741824 Sep 28 15:28:54 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:55 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a 1073741824" returned: 0 in 0.432s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:55 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a Sep 28 15:28:55 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:55 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a" returned: 0 in 0.273s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c86ec40-ba6d-4d49-999e-caed2a5fbd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e926e2f7-1e26-4dae-a19a-38021441b01a', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a471a813-4a58-47b0-836c-6d3b0f65f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:55 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Volume volume-e926e2f7-1e26-4dae-a19a-38021441b01a (e926e2f7-1e26-4dae-a19a-38021441b01a): created successfully Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a471a813-4a58-47b0-836c-6d3b0f65f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (ccfd01ed-3c99-4e87-89f2-40f38a783f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:55 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-7bacebca-42b3-4df2-a970-c99699dd44ff tempest-ProjectReaderTests-1924792170 None] Created volume successfully. Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-e926e2f7-1e26-4dae-a19a-38021441b01a-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-e926e2f7-1e26-4dae-a19a-38021441b01a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-quobyte-e926e2f7-1e26-4dae-a19a-38021441b01a" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-e926e2f7-1e26-4dae-a19a-38021441b01a" acquired by "delete_volume" :: waited 0.020s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc25e2a0-f53a-4f6b-9996-0b041f812957]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:55 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:55 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a Sep 28 15:28:55 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:56 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a" returned: 0 in 0.403s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:56 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a Sep 28 15:28:56 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:56 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-e926e2f7-1e26-4dae-a19a-38021441b01a" returned: 0 in 0.264s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-e926e2f7-1e26-4dae-a19a-38021441b01a" released by "delete_volume" :: held 0.715s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Created reservations ['6e2e39a2-1c6a-40b8-aca6-ce462ec44936', 'cae9dd1c-635b-434c-8fa6-19e90e68f98e', '50e50fd7-b4e7-4b97-af11-5369c3370028', 'b4c01db6-db0d-4122-8d4e-093f3ba0c307'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:56 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:56 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:56 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.250s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:56 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Deleted volume successfully. Sep 28 15:28:56 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-c60c9d44-af4e-46a5-bbda-40dd11a08622 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-e926e2f7-1e26-4dae-a19a-38021441b01a-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (cd8983cb-e5b8-464c-a5f5-277751e7eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d673df6-da92-4ccf-939a-a8562d5a782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d673df6-da92-4ccf-939a-a8562d5a782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359951409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83995797-39cd-448f-a8fe-a322fc87c1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:57Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f4e452-a980-481b-b453-b998ec8d0513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f4e452-a980-481b-b453-b998ec8d0513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c6057b-1601-47c5-b55b-3d59ea9fbf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31c6057b-1601-47c5-b55b-3d59ea9fbf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83995797-39cd-448f-a8fe-a322fc87c1be', 'volume_name': 'volume-83995797-39cd-448f-a8fe-a322fc87c1be', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad006bf-443e-4e18-b228-284685c11c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad006bf-443e-4e18-b228-284685c11c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fb1adc-e080-4730-9880-398b9db67d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:57 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Volume 83995797-39cd-448f-a8fe-a322fc87c1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83995797-39cd-448f-a8fe-a322fc87c1be', 'volume_size': 1} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1359951409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83995797-39cd-448f-a8fe-a322fc87c1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:28:57Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Creating volume 83995797-39cd-448f-a8fe-a322fc87c1be {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:28:57 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:57 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be 1073741824 Sep 28 15:28:57 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:57 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be 1073741824" returned: 0 in 0.399s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:57 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:57 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be Sep 28 15:28:57 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:58 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be" returned: 0 in 0.265s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6fb1adc-e080-4730-9880-398b9db67d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83995797-39cd-448f-a8fe-a322fc87c1be', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ffe9c1-0395-40eb-8e69-131ad5adcc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:28:58 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Volume volume-83995797-39cd-448f-a8fe-a322fc87c1be (83995797-39cd-448f-a8fe-a322fc87c1be): created successfully Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67ffe9c1-0395-40eb-8e69-131ad5adcc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (cd8983cb-e5b8-464c-a5f5-277751e7eeee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:28:58 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-fc489366-ced1-4192-bc00-5af763a31501 tempest-ProjectReaderTests-1924792170 None] Created volume successfully. Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-83995797-39cd-448f-a8fe-a322fc87c1be-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Lock "cinder-83995797-39cd-448f-a8fe-a322fc87c1be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-quobyte-83995797-39cd-448f-a8fe-a322fc87c1be" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-83995797-39cd-448f-a8fe-a322fc87c1be" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[029db5b0-347c-4a6c-9a06-9d91ea863bfd]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:58 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be Sep 28 15:28:58 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:58 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be" returned: 0 in 0.357s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:58 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:58 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be Sep 28 15:28:58 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:59 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-83995797-39cd-448f-a8fe-a322fc87c1be" returned: 0 in 0.254s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-83995797-39cd-448f-a8fe-a322fc87c1be" released by "delete_volume" :: held 0.653s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Created reservations ['9591aff1-bdcc-4c5e-9a80-a441eaff79f6', '226fecb1-e8d5-4c75-a0f3-a42ec1a7d615', '39c55260-0e45-46db-ab5b-ba4af959cb30', '9af4100b-c629-44a5-bab0-e8c16f7172e6'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:28:59 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:28:59 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:28:59 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.252s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:28:59 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Deleted volume successfully. Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-478ce4b8-659b-4955-8b23-eddaf8df84ab tempest-ProjectReaderTests-1924792170 None] Lock "cinder-83995797-39cd-448f-a8fe-a322fc87c1be-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:28:59 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (55dd4b8c-897b-4ebf-8ac5-6ba6f089d4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117fd41f-8b6a-4559-9a7b-34ff48346c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117fd41f-8b6a-4559-9a7b-34ff48346c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994123858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d4ffbc-3df5-4888-81b2-f1546c46fc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:29:00Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2984688a-07d0-443b-8f13-a35230235861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2984688a-07d0-443b-8f13-a35230235861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b74f9b-f828-45a0-936d-a945391b27e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b74f9b-f828-45a0-936d-a945391b27e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d4ffbc-3df5-4888-81b2-f1546c46fc1f', 'volume_name': 'volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f90087c-a344-4875-83ca-0eb50c83380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f90087c-a344-4875-83ca-0eb50c83380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd2c2b1-5691-48fd-bc84-c2da722460de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Volume 31d4ffbc-3df5-4888-81b2-f1546c46fc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f', 'volume_size': 1} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994123858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d4ffbc-3df5-4888-81b2-f1546c46fc1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:29:00Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Creating volume 31d4ffbc-3df5-4888-81b2-f1546c46fc1f {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:29:00 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:00 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f 1073741824 Sep 28 15:29:00 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:00 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f 1073741824" returned: 0 in 0.417s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:00 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f Sep 28 15:29:00 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:00 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f" returned: 0 in 0.249s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd2c2b1-5691-48fd-bc84-c2da722460de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f92345f-f997-405d-b455-e82ded0c4970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:00 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Volume volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f (31d4ffbc-3df5-4888-81b2-f1546c46fc1f): created successfully Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f92345f-f997-405d-b455-e82ded0c4970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:00 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (55dd4b8c-897b-4ebf-8ac5-6ba6f089d4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:29:00 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-f1d0fa65-aa27-4656-89f9-d621e00e6ba6 tempest-ProjectReaderTests-1924792170 None] Created volume successfully. Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-31d4ffbc-3df5-4888-81b2-f1546c46fc1f-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-31d4ffbc-3df5-4888-81b2-f1546c46fc1f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-quobyte-31d4ffbc-3df5-4888-81b2-f1546c46fc1f" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-31d4ffbc-3df5-4888-81b2-f1546c46fc1f" acquired by "delete_volume" :: waited 0.016s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[893b109f-04ba-4bd6-97d0-9b03ad098930]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:01 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f Sep 28 15:29:01 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:01 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f" returned: 0 in 0.370s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:01 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f Sep 28 15:29:01 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:01 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-31d4ffbc-3df5-4888-81b2-f1546c46fc1f" returned: 0 in 0.249s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-31d4ffbc-3df5-4888-81b2-f1546c46fc1f" released by "delete_volume" :: held 0.659s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Created reservations ['14dd0a0e-b8c5-434e-a630-0ba982911e06', 'fb41b061-5e69-4e48-bb9e-46c81d3a2c78', 'a9894475-1154-4b42-8634-c92218b12aa9', '1367d916-5f3b-43db-a131-9a0ae3ab8f88'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:29:01 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:01 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:29:01 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:02 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.243s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:29:02 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Deleted volume successfully. Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-1481c808-ab8a-415f-a153-5e46eda6fcf3 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-31d4ffbc-3df5-4888-81b2-f1546c46fc1f-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.flows.manager.create_volume [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86301) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (9e7cf325-94fa-4916-9109-626153049a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcac1d4-19e6-403e-9657-919b98a34ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddcac1d4-19e6-403e-9657-919b98a34ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828516122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f878177-b536-41aa-b5df-c2ff96905833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:29:03Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ca7366-6a6e-48df-90df-1e85d34591ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ca7366-6a6e-48df-90df-1e85d34591ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d34827-efd3-4c64-82da-eddfff9d1b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d34827-efd3-4c64-82da-eddfff9d1b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f878177-b536-41aa-b5df-c2ff96905833', 'volume_name': 'volume-7f878177-b536-41aa-b5df-c2ff96905833', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef12dea-3132-48a1-a9ea-743dfc163f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef12dea-3132-48a1-a9ea-743dfc163f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93537871-df14-461f-8951-e85f2f1331ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:02 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Volume 7f878177-b536-41aa-b5df-c2ff96905833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f878177-b536-41aa-b5df-c2ff96905833', 'volume_size': 1} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T13:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-828516122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f878177-b536-41aa-b5df-c2ff96905833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d02c89df8848d0900bfdf267adb177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T13:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T13:29:03Z,use_quota=True,user_id='ab4c83f3d6f94ed9827ae769d33b067e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3177590-6ed3-4e59-9c82-bf7a67e4c9ff),volume_type_id=c3177590-6ed3-4e59-9c82-bf7a67e4c9ff)}" {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.remotefs [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Creating volume 7f878177-b536-41aa-b5df-c2ff96905833 {{(pid=86301) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Selected osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 as target Quobyte volume. {{(pid=86301) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 15:29:02 devstack cinder-volume[86301]: INFO cinder.volume.drivers.remotefs [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] casted to osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428 Sep 28 15:29:02 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 1073741824 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:02 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 1073741824 Sep 28 15:29:02 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:03 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 1073741824" returned: 0 in 0.427s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:03 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 Sep 28 15:29:03 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:03 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833" returned: 0 in 0.251s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'} {{(pid=86301) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93537871-df14-461f-8951-e85f2f1331ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f878177-b536-41aa-b5df-c2ff96905833', 'volume_size': 1}' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d25a1b4-9f34-4e5f-914c-35ea27d91ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 15:29:03 devstack cinder-volume[86301]: INFO cinder.volume.flows.manager.create_volume [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Volume volume-7f878177-b536-41aa-b5df-c2ff96905833 (7f878177-b536-41aa-b5df-c2ff96905833): created successfully Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d25a1b4-9f34-4e5f-914c-35ea27d91ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86301) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Flow 'volume_create_manager' (9e7cf325-94fa-4916-9109-626153049a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86301) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 15:29:03 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-04fb2080-7429-42d0-b811-9712eb6ae42f tempest-ProjectReaderTests-1924792170 None] Created volume successfully. Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-7f878177-b536-41aa-b5df-c2ff96905833-delete_volume" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-7f878177-b536-41aa-b5df-c2ff96905833-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "cinder-quobyte-7f878177-b536-41aa-b5df-c2ff96905833" by "delete_volume" {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-7f878177-b536-41aa-b5df-c2ff96905833" acquired by "delete_volume" :: waited 0.015s {{(pid=86301) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b428a1-3718-40d6-87eb-308317d5cb27]: (4, 'qcow2') {{(pid=88234) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 15:29:03 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:03 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 Sep 28 15:29:03 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:04 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833" returned: 0 in 0.402s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:04 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833 Sep 28 15:29:04 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:04 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669/volume-7f878177-b536-41aa-b5df-c2ff96905833" returned: 0 in 0.243s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-quobyte-7f878177-b536-41aa-b5df-c2ff96905833" released by "delete_volume" :: held 0.692s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG cinder.quota [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Created reservations ['084437d2-93a7-4201-9b0c-0b5dfab1da3b', '01345bd0-e7ef-45a2-8864-ebe5efc43ee3', '1957f1b1-2c14-437a-9134-3ca8d9cac92e', 'b581f207-6f58-4bb4-a3ab-385c65971ae2'] {{(pid=86301) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428': None} {{(pid=86301) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG cinder.volume.drivers.quobyte [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0f553832-93a1-4553-99cf-f4a61539b428'] {{(pid=86301) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.lockutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86301) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:29:04 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669 Sep 28 15:29:04 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:29:04 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG oslo_concurrency.processutils [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ef7475ffbdd63e20531127c23da20669" returned: 0 in 0.265s {{(pid=86301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG cinder.manager [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Notifying Schedulers of capabilities ... {{(pid=86301) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:29:04 devstack cinder-volume[86301]: INFO cinder.volume.manager [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Deleted volume successfully. Sep 28 15:29:04 devstack cinder-volume[86301]: DEBUG cinder.coordination [None req-61c89b60-88fc-4264-a4e5-071a691cd363 tempest-ProjectReaderTests-1924792170 None] Lock "cinder-7f878177-b536-41aa-b5df-c2ff96905833-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=86301) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 15:29:14 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:SELECT=30,cinder:INSERT=9,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:29:14 devstack cinder-volume[86301]: DEBUG dbcounter [-] [86301] Writing DB stats cinder:UPDATE=48,cinder:SELECT=26,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}